[jira] [Commented] (HDFS-13194) CachePool permissions incorrectly checked

2018-02-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16376839#comment-16376839 ] He Xiaoqiao commented on HDFS-13194: +1, maybe the following demonstrates approach is

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375520#comment-16375520 ] He Xiaoqiao commented on HDFS-13183: [~ajayydv], Thanks for your comments, {quote}It w

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13183: --- Attachment: HDFS-13183-trunk.002.patch > Standby NameNode process getBlocks request to reduce Active l

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375299#comment-16375299 ] He Xiaoqiao commented on HDFS-12749: [~xkrogen] Thanks for your review and comments. {

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374325#comment-16374325 ] He Xiaoqiao commented on HDFS-13183: The WIP patch V1 demonstrates approach for Standb

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13183: --- Attachment: HDFS-13183-trunk.001.patch > Standby NameNode process getBlocks request to reduce Active l

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12749: --- Attachment: HDFS-12749-trunk.003.patch > DN may not send block report to NN after NN restart > ---

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374295#comment-16374295 ] He Xiaoqiao commented on HDFS-12749: Thanks to [~kihwal] for review and comments. {quo

[jira] [Created] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-23 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-13183: -- Summary: Standby NameNode process getBlocks request to reduce Active load Key: HDFS-13183 URL: https://issues.apache.org/jira/browse/HDFS-13183 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8966) Separate the lock used in namespace and block management layer

2018-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16373861#comment-16373861 ] He Xiaoqiao commented on HDFS-8966: --- [~wheat9],[~jingzhao] is this issue still ongoing?

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372749#comment-16372749 ] He Xiaoqiao commented on HDFS-12749: check failed UT(#TestFileCreationEmpty) and test

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12749: --- Component/s: datanode > DN may not send block report to NN after NN restart >

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12749: --- Affects Version/s: 2.9.1 2.8.3 2.7.5

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12749: --- Attachment: HDFS-12749-branch-2.7.002.patch > DN may not send block report to NN after NN restart > --

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372595#comment-16372595 ] He Xiaoqiao commented on HDFS-12749: ping [~kihwal], [~xkrogen] I upload new patch reb

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365105#comment-16365105 ] He Xiaoqiao commented on HDFS-12749: [~kihwal],[~xkrogen] Thanks for your comments. {q

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364280#comment-16364280 ] He Xiaoqiao commented on HDFS-12749: ping [~xkrogen] I also had seen this problems in

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360400#comment-16360400 ] He Xiaoqiao commented on HDFS-10453: I checked the failed UTs and tested locally, it s

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359237#comment-16359237 ] He Xiaoqiao commented on HDFS-10453: [~arpitagarwal] upload new patches without unit t

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-trunk.002.patch HDFS-10453-branch-3.0.002.patch

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16358323#comment-16358323 ] He Xiaoqiao commented on HDFS-10453: [~ajayydv] {quote} As Erik Krogen mentioned earli

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16357897#comment-16357897 ] He Xiaoqiao commented on HDFS-10453: [~xkrogen],[~ajayydv] Sorry for so late comments.

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-trunk.001.patch HDFS-10453-branch-3.0.001.patch

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: (was: HDFS-10453-branch-2.7.008.patch) > ReplicationMonitor thread could stuck for lon

[jira] [Comment Edited] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16354927#comment-16354927 ] He Xiaoqiao edited comment on HDFS-10453 at 2/7/18 4:11 AM: {q

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.008.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: (was: HDFS-10453-branch-2.7.008.patch) > ReplicationMonitor thread could stuck for lon

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16354927#comment-16354927 ] He Xiaoqiao commented on HDFS-10453: {quote}However, going through this makes me reali

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.008.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353480#comment-16353480 ] He Xiaoqiao commented on HDFS-10453: [~xkrogen] [~vagarychen], Thanks for you comment

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.007.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351434#comment-16351434 ] He Xiaoqiao commented on HDFS-10453: hi [~ajayydv] {quote}This check {{if(bc == null |

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350705#comment-16350705 ] He Xiaoqiao commented on HDFS-10453: ping [~ajayydv], please share your feedback and g

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349730#comment-16349730 ] He Xiaoqiao commented on HDFS-10453: [~ajayydv] Thanks for your reviews. In the lastes

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-01-31 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Fix Version/s: 2.7.6 > ReplicationMonitor thread could stuck for long time due to the race between >

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-01-31 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348056#comment-16348056 ] He Xiaoqiao commented on HDFS-10453: [~ajayydv] Thank you for your suggestion,  I just

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-01-31 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.006.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-12-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16305967#comment-16305967 ] He Xiaoqiao commented on HDFS-7060: --- The last patch is good for me. there are some sugges

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-12-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303660#comment-16303660 ] He Xiaoqiao commented on HDFS-7060: --- hi [~yangjiandan] [~cheersyang], we encountered this

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.005.patch [~Octivian] thanks for your suggestions, we do need to upd

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281696#comment-16281696 ] He Xiaoqiao commented on HDFS-10453: [~Octivian] The new patch is ready and update bas

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.004.patch attach new patch for branch-2.7 > ReplicationMonitor thre

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281571#comment-16281571 ] He Xiaoqiao commented on HDFS-10453: [~Octivian] [~genericqa] Thanks for your comments

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226339#comment-16226339 ] He Xiaoqiao commented on HDFS-12749: [~tanyuxin] could you attach some more troublesho

[jira] [Commented] (HDFS-11231) federation support to linux-like mount type

2017-01-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804218#comment-15804218 ] He Xiaoqiao commented on HDFS-11231: [~andrew.wang] Thanks for your comments. Yes, i t

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-12-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15756632#comment-15756632 ] He Xiaoqiao commented on HDFS-10453: [~yangyishan0901m] patch is ready and it works we

[jira] [Created] (HDFS-11231) federation support to linux-like mount type

2016-12-11 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-11231: -- Summary: federation support to linux-like mount type Key: HDFS-11231 URL: https://issues.apache.org/jira/browse/HDFS-11231 Project: Hadoop HDFS Issue Type: Impro

[jira] [Issue Comment Deleted] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Comment: was deleted (was: [~wutak...@amazon.com] Thanks for your comments, The patch is ready, and i

[jira] [Issue Comment Deleted] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Comment: was deleted (was: [~wutak...@amazon.com] Thanks for your comments, The patch is ready, and i

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710645#comment-15710645 ] He Xiaoqiao commented on HDFS-10453: [~wutak...@amazon.com] Thanks for your comments,

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710641#comment-15710641 ] He Xiaoqiao commented on HDFS-10453: [~wutak...@amazon.com] Thanks for your comments,

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15710643#comment-15710643 ] He Xiaoqiao commented on HDFS-10453: [~wutak...@amazon.com] Thanks for your comments,

[jira] [Resolved] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2016-09-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao resolved HDFS-9334. --- Resolution: Duplicate HDFS-6830 has fixed this. > NameNode crash caused by ArrayIndexOutOfBoundsExcept

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Status: Patch Available (was: Open) re-submit patch. > Decrease memory frequent exchange of Centrali

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Status: Open (was: Patch Available) > Decrease memory frequent exchange of Centralized Cache Manageme

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Attachment: (was: HDFS-10782-branch-2.001.patch) > Decrease memory frequent exchange of Centralize

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Attachment: HDFS-10782-branch-2.001.patch > Decrease memory frequent exchange of Centralized Cache Man

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Labels: patch (was: ) Status: Patch Available (was: Open) NN returns uncached blocks for #getBlo

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Attachment: HDFS-10782-branch-2.001.patch submit patch for branch-2.7 > Decrease memory frequent exch

[jira] [Created] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-21 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-10782: -- Summary: Decrease memory frequent exchange of Centralized Cache Management when run balancer Key: HDFS-10782 URL: https://issues.apache.org/jira/browse/HDFS-10782 Project

[jira] [Updated] (HDFS-10728) DN can't communicate with NN when IP address of NN changed since Auth failed

2016-08-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10728: --- Affects Version/s: 2.7.1 Description: In security authentication hadoop cluster with Kerbero

[jira] [Created] (HDFS-10728) DataNode cann't connect to NameNode

2016-08-07 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-10728: -- Summary: DataNode cann't connect to NameNode Key: HDFS-10728 URL: https://issues.apache.org/jira/browse/HDFS-10728 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

2016-07-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10606: --- Affects Version/s: (was: 2.7.1) 2.7.0 Status: Patch Available

[jira] [Updated] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

2016-07-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10606: --- Attachment: HDFS-10606-branch-2.7.001.patch submit patch for branch-2.7 > TrashPolicyDefault supports

[jira] [Created] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

2016-07-11 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-10606: -- Summary: TrashPolicyDefault supports time of auto clean up can configured Key: HDFS-10606 URL: https://issues.apache.org/jira/browse/HDFS-10606 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client

2016-07-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15360989#comment-15360989 ] He Xiaoqiao commented on HDFS-7858: --- hi [~asuresh] when i patch this to 2.7.1, it throws

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-06-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Affects Version/s: 2.5.2 2.6.4 > ReplicationMonitor thread could stuck for long

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15306312#comment-15306312 ] He Xiaoqiao commented on HDFS-10453: hi [~vinayrpet], thanks for your comments. Actual

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Affects Version/s: 2.4.1 Status: Patch Available (was: Open) Kick jenkins for branch-2

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Open (was: Patch Available) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.003.patch > ReplicationMonitor thread could stuck for long time due to

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Affects Version/s: 2.7.1 > ReplicationMonitor thread could stuck for long time due to the race between

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15305222#comment-15305222 ] He Xiaoqiao commented on HDFS-10453: hi [~shahrs87], thanks a lot for your watching th

[jira] [Commented] (HDFS-8718) Block replicating cannot work after upgrading to 2.7

2016-05-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303438#comment-15303438 ] He Xiaoqiao commented on HDFS-8718: --- hi [~jianbginglover] and [~kanaka], ReplicationMonit

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Fix Version/s: (was: 2.7.1) Affects Version/s: (was: 2.7.1) Target Version/s: (w

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453.001.patch > ReplicationMonitor thread could stuck for long time due to the race

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Open (was: Patch Available) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Target Version/s: 2.7.1 Status: Patch Available (was: Open) > ReplicationMonitor thread

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Open (was: Patch Available) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Patch Available (was: Open) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Open (was: Patch Available) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: (was: HDFS-10453.patch) > ReplicationMonitor thread could stuck for long time due to t

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.001.patch > ReplicationMonitor thread could stuck for long time due to

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Fix Version/s: 2.7.1 Status: Patch Available (was: Open) committe to branch-2.7.1 > Repli

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453.patch > ReplicationMonitor thread could stuck for long time due to the race bet

[jira] [Created] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-10453: -- Summary: ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster. Key: HDFS-10453 URL: https://issues.apache

[jira] [Commented] (HDFS-8718) Block replicating cannot work after upgrading to 2.7

2016-05-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15268067#comment-15268067 ] He Xiaoqiao commented on HDFS-8718: --- i met the same problem after upgraded the cluster to

[jira] [Commented] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2015-10-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14979765#comment-14979765 ] He Xiaoqiao commented on HDFS-9334: --- the following scenario may occur ArrayIndexOutOfBoun

[jira] [Commented] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2015-10-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14979748#comment-14979748 ] He Xiaoqiao commented on HDFS-9334: --- hi [~walter.k.su], the case happens at SBN when do e

[jira] [Created] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2015-10-28 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-9334: - Summary: NameNode crash caused by ArrayIndexOutOfBoundsException Key: HDFS-9334 URL: https://issues.apache.org/jira/browse/HDFS-9334 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-10-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951576#comment-14951576 ] He Xiaoqiao commented on HDFS-9149: --- hi [~He Tianyi] after check source code, maybe {{get

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-10-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942122#comment-14942122 ] He Xiaoqiao commented on HDFS-9149: --- [~He Tianyi] thanks for your advice. i'll work on th

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-10-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941360#comment-14941360 ] He Xiaoqiao commented on HDFS-9149: --- Thanks, [~He Tianyi]. it's not a good solution exac

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-10-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941243#comment-14941243 ] He Xiaoqiao commented on HDFS-9149: --- hi [~He Tianyi]], thank you for your comments. {quot

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-09-27 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14909767#comment-14909767 ] He Xiaoqiao commented on HDFS-9149: --- [~He Tianyi] i think it is not necessary to extend {

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-09-27 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14909768#comment-14909768 ] He Xiaoqiao commented on HDFS-9149: --- [~He Tianyi] i think it is not necessary to extend {

[jira] [Updated] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-09-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-9149: -- Description: {{sortByDistance}} doesn't consider multi-datacenter when read data, so there my be reading

[jira] [Created] (HDFS-9149) Consider multi

2015-09-26 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-9149: - Summary: Consider multi Key: HDFS-9149 URL: https://issues.apache.org/jira/browse/HDFS-9149 Project: Hadoop HDFS Issue Type: Improvement Reporter: He X

[jira] [Updated] (HDFS-9068) SBN checkpoint could not work after the only name directory recovery from failure

2015-09-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-9068: -- Attachment: HDFS-9068.patch Attach patch: check failure directory if OK before saving fsimage. > SBN che

[jira] [Commented] (HDFS-9068) SBN checkpoint could not work after the only name directory recovery from failure

2015-09-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742366#comment-14742366 ] He Xiaoqiao commented on HDFS-9068: --- it is necessary to add thread to periodic check if t

<    3   4   5   6   7   8   9   >