[jira] [Commented] (HDFS-13194) CachePool permissions incorrectly checked

2018-02-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376839#comment-16376839 ] He Xiaoqiao commented on HDFS-13194: +1, maybe the following demonstrates approach is more POSIX-like

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375520#comment-16375520 ] He Xiaoqiao commented on HDFS-13183: [~ajayydv], Thanks for your comments, {quote}It would be good if

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13183: --- Attachment: HDFS-13183-trunk.002.patch > Standby NameNode process getBlocks request to reduce Active

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375299#comment-16375299 ] He Xiaoqiao commented on HDFS-12749: [~xkrogen] Thanks for your review and comments. {quote}Are you

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374325#comment-16374325 ] He Xiaoqiao commented on HDFS-13183: The WIP patch V1 demonstrates approach for Standby NameNode

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13183: --- Attachment: HDFS-13183-trunk.001.patch > Standby NameNode process getBlocks request to reduce Active

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12749: --- Attachment: HDFS-12749-trunk.003.patch > DN may not send block report to NN after NN restart >

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-23 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374295#comment-16374295 ] He Xiaoqiao commented on HDFS-12749: Thanks to [~kihwal] for review and comments. {quote}It seems okay

[jira] [Created] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-02-23 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-13183: -- Summary: Standby NameNode process getBlocks request to reduce Active load Key: HDFS-13183 URL: https://issues.apache.org/jira/browse/HDFS-13183 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8966) Separate the lock used in namespace and block management layer

2018-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373861#comment-16373861 ] He Xiaoqiao commented on HDFS-8966: --- [~wheat9],[~jingzhao] is this issue still ongoing? > Separate the

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372749#comment-16372749 ] He Xiaoqiao commented on HDFS-12749: check failed UT(#TestFileCreationEmpty) and test locally, it

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12749: --- Component/s: datanode > DN may not send block report to NN after NN restart >

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12749: --- Affects Version/s: 2.9.1 2.8.3 2.7.5

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12749: --- Attachment: HDFS-12749-branch-2.7.002.patch > DN may not send block report to NN after NN restart >

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-22 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372595#comment-16372595 ] He Xiaoqiao commented on HDFS-12749: ping [~kihwal], [~xkrogen] I upload new patch rebase branch-2.7,

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16365105#comment-16365105 ] He Xiaoqiao commented on HDFS-12749: [~kihwal],[~xkrogen] Thanks for your comments. {quote}the problem

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-02-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364280#comment-16364280 ] He Xiaoqiao commented on HDFS-12749: ping [~xkrogen] I also had seen this problems in our big

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360400#comment-16360400 ] He Xiaoqiao commented on HDFS-10453: I checked the failed UTs and tested locally, it seems to work

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359237#comment-16359237 ] He Xiaoqiao commented on HDFS-10453: [~arpitagarwal] upload new patches without unit test.

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-trunk.002.patch HDFS-10453-branch-3.0.002.patch

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358323#comment-16358323 ] He Xiaoqiao commented on HDFS-10453: [~ajayydv] {quote} As Erik Krogen mentioned earlier "A deleted

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357897#comment-16357897 ] He Xiaoqiao commented on HDFS-10453: [~xkrogen],[~ajayydv] Sorry for so late comments. I just update

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-trunk.001.patch HDFS-10453-branch-3.0.001.patch

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-08 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: (was: HDFS-10453-branch-2.7.008.patch) > ReplicationMonitor thread could stuck for

[jira] [Comment Edited] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354927#comment-16354927 ] He Xiaoqiao edited comment on HDFS-10453 at 2/7/18 4:11 AM: {quote}However,

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.008.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: (was: HDFS-10453-branch-2.7.008.patch) > ReplicationMonitor thread could stuck for

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354927#comment-16354927 ] He Xiaoqiao commented on HDFS-10453: {quote}However, going through this makes me realize, a more

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.008.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353480#comment-16353480 ] He Xiaoqiao commented on HDFS-10453: [~xkrogen] [~vagarychen], Thanks for you comments, I attach

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.007.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-03 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351434#comment-16351434 ] He Xiaoqiao commented on HDFS-10453: hi [~ajayydv] {quote}This check {{if(bc == null ||

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350705#comment-16350705 ] He Xiaoqiao commented on HDFS-10453: ping [~ajayydv], please share your feedback and give some

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-01 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349730#comment-16349730 ] He Xiaoqiao commented on HDFS-10453: [~ajayydv] Thanks for your reviews. In the lastest patch, I check

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-01-31 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Fix Version/s: 2.7.6 > ReplicationMonitor thread could stuck for long time due to the race between >

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-01-31 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348056#comment-16348056 ] He Xiaoqiao commented on HDFS-10453: [~ajayydv] Thank you for your suggestion,  I just attach new

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-01-31 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.006.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-12-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305967#comment-16305967 ] He Xiaoqiao commented on HDFS-7060: --- The last patch is good for me. there are some suggestions for

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-12-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16303660#comment-16303660 ] He Xiaoqiao commented on HDFS-7060: --- hi [~yangjiandan] [~cheersyang], we encountered this problems as

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.005.patch [~Octivian] thanks for your suggestions, we do need to

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281696#comment-16281696 ] He Xiaoqiao commented on HDFS-10453: [~Octivian] The new patch is ready and update based on you

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.004.patch attach new patch for branch-2.7 > ReplicationMonitor

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281571#comment-16281571 ] He Xiaoqiao commented on HDFS-10453: [~Octivian] [~genericqa] Thanks for your comments and tests.

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-31 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226339#comment-16226339 ] He Xiaoqiao commented on HDFS-12749: [~tanyuxin] could you attach some more troubleshoot or exception

[jira] [Commented] (HDFS-11231) federation support to linux-like mount type

2017-01-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15804218#comment-15804218 ] He Xiaoqiao commented on HDFS-11231: [~andrew.wang] Thanks for your comments. Yes, i think there are

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-12-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15756632#comment-15756632 ] He Xiaoqiao commented on HDFS-10453: [~yangyishan0901m] patch is ready and it works well for long

[jira] [Created] (HDFS-11231) federation support to linux-like mount type

2016-12-11 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-11231: -- Summary: federation support to linux-like mount type Key: HDFS-11231 URL: https://issues.apache.org/jira/browse/HDFS-11231 Project: Hadoop HDFS Issue Type:

[jira] [Issue Comment Deleted] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Comment: was deleted (was: [~wutak...@amazon.com] Thanks for your comments, The patch is ready, and i

[jira] [Issue Comment Deleted] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Comment: was deleted (was: [~wutak...@amazon.com] Thanks for your comments, The patch is ready, and i

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710645#comment-15710645 ] He Xiaoqiao commented on HDFS-10453: [~wutak...@amazon.com] Thanks for your comments, The patch is

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710641#comment-15710641 ] He Xiaoqiao commented on HDFS-10453: [~wutak...@amazon.com] Thanks for your comments, The patch is

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710643#comment-15710643 ] He Xiaoqiao commented on HDFS-10453: [~wutak...@amazon.com] Thanks for your comments, The patch is

[jira] [Resolved] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2016-09-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao resolved HDFS-9334. --- Resolution: Duplicate HDFS-6830 has fixed this. > NameNode crash caused by

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Status: Patch Available (was: Open) re-submit patch. > Decrease memory frequent exchange of

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Status: Open (was: Patch Available) > Decrease memory frequent exchange of Centralized Cache

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Attachment: (was: HDFS-10782-branch-2.001.patch) > Decrease memory frequent exchange of

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Attachment: HDFS-10782-branch-2.001.patch > Decrease memory frequent exchange of Centralized Cache

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Labels: patch (was: ) Status: Patch Available (was: Open) NN returns uncached blocks for

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Attachment: HDFS-10782-branch-2.001.patch submit patch for branch-2.7 > Decrease memory frequent

[jira] [Created] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-21 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-10782: -- Summary: Decrease memory frequent exchange of Centralized Cache Management when run balancer Key: HDFS-10782 URL: https://issues.apache.org/jira/browse/HDFS-10782

[jira] [Updated] (HDFS-10728) DN can't communicate with NN when IP address of NN changed since Auth failed

2016-08-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10728: --- Affects Version/s: 2.7.1 Description: In security authentication hadoop cluster with

[jira] [Created] (HDFS-10728) DataNode cann't connect to NameNode

2016-08-07 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-10728: -- Summary: DataNode cann't connect to NameNode Key: HDFS-10728 URL: https://issues.apache.org/jira/browse/HDFS-10728 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

2016-07-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10606: --- Affects Version/s: (was: 2.7.1) 2.7.0 Status: Patch

[jira] [Updated] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

2016-07-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10606: --- Attachment: HDFS-10606-branch-2.7.001.patch submit patch for branch-2.7 > TrashPolicyDefault

[jira] [Created] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

2016-07-11 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-10606: -- Summary: TrashPolicyDefault supports time of auto clean up can configured Key: HDFS-10606 URL: https://issues.apache.org/jira/browse/HDFS-10606 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client

2016-07-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360989#comment-15360989 ] He Xiaoqiao commented on HDFS-7858: --- hi [~asuresh] when i patch this to 2.7.1, it throws some exception

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-06-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Affects Version/s: 2.5.2 2.6.4 > ReplicationMonitor thread could stuck for

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15306312#comment-15306312 ] He Xiaoqiao commented on HDFS-10453: hi [~vinayrpet], thanks for your comments. Actually this case

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Affects Version/s: 2.4.1 Status: Patch Available (was: Open) Kick jenkins for

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Open (was: Patch Available) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.003.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Affects Version/s: 2.7.1 > ReplicationMonitor thread could stuck for long time due to the race

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305222#comment-15305222 ] He Xiaoqiao commented on HDFS-10453: hi [~shahrs87], thanks a lot for your watching this issue. It

[jira] [Commented] (HDFS-8718) Block replicating cannot work after upgrading to 2.7

2016-05-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303438#comment-15303438 ] He Xiaoqiao commented on HDFS-8718: --- hi [~jianbginglover] and [~kanaka], ReplicationMonitor stuck for

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Fix Version/s: (was: 2.7.1) Affects Version/s: (was: 2.7.1) Target Version/s:

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453.001.patch > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Open (was: Patch Available) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Target Version/s: 2.7.1 Status: Patch Available (was: Open) > ReplicationMonitor

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Open (was: Patch Available) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Patch Available (was: Open) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Open (was: Patch Available) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: (was: HDFS-10453.patch) > ReplicationMonitor thread could stuck for long time due to

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.001.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Fix Version/s: 2.7.1 Status: Patch Available (was: Open) committe to branch-2.7.1 >

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453.patch > ReplicationMonitor thread could stuck for long time due to the race

[jira] [Created] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-10453: -- Summary: ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster. Key: HDFS-10453 URL:

[jira] [Commented] (HDFS-8718) Block replicating cannot work after upgrading to 2.7

2016-05-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268067#comment-15268067 ] He Xiaoqiao commented on HDFS-8718: --- i met the same problem after upgraded the cluster to 2.7.1, and

[jira] [Created] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2015-10-28 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-9334: - Summary: NameNode crash caused by ArrayIndexOutOfBoundsException Key: HDFS-9334 URL: https://issues.apache.org/jira/browse/HDFS-9334 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2015-10-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979748#comment-14979748 ] He Xiaoqiao commented on HDFS-9334: --- hi [~walter.k.su], the case happens at SBN when do editlog tailer.

[jira] [Commented] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2015-10-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979765#comment-14979765 ] He Xiaoqiao commented on HDFS-9334: --- the following scenario may occur ArrayIndexOutOfBoundsException: 1.

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-10-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951576#comment-14951576 ] He Xiaoqiao commented on HDFS-9149: --- hi [~He Tianyi] after check source code, maybe {{getDistance}} could

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-10-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941243#comment-14941243 ] He Xiaoqiao commented on HDFS-9149: --- hi [~He Tianyi]], thank you for your comments. {quote} The only

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-10-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941360#comment-14941360 ] He Xiaoqiao commented on HDFS-9149: --- Thanks, [~He Tianyi]. it's not a good solution exactly. maybe we

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-10-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942122#comment-14942122 ] He Xiaoqiao commented on HDFS-9149: --- [~He Tianyi] thanks for your advice. i'll work on that. > Consider

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-09-27 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909767#comment-14909767 ] He Xiaoqiao commented on HDFS-9149: --- [~He Tianyi] i think it is not necessary to extend

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-09-27 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909768#comment-14909768 ] He Xiaoqiao commented on HDFS-9149: --- [~He Tianyi] i think it is not necessary to extend

[jira] [Created] (HDFS-9149) Consider multi

2015-09-26 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-9149: - Summary: Consider multi Key: HDFS-9149 URL: https://issues.apache.org/jira/browse/HDFS-9149 Project: Hadoop HDFS Issue Type: Improvement Reporter: He

[jira] [Updated] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-09-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-9149: -- Description: {{sortByDistance}} doesn't consider multi-datacenter when read data, so there my be reading

[jira] [Commented] (HDFS-9068) SBN checkpoint could not work after the only name directory recovery from failure

2015-09-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742366#comment-14742366 ] He Xiaoqiao commented on HDFS-9068: --- it is necessary to add thread to periodic check if the sd in

[jira] [Created] (HDFS-9068) SBN checkpoint could not work after the only name directory recovery from failure

2015-09-13 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-9068: - Summary: SBN checkpoint could not work after the only name directory recovery from failure Key: HDFS-9068 URL: https://issues.apache.org/jira/browse/HDFS-9068 Project:

<    3   4   5   6   7   8   9   >