[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443471#comment-16443471 ] genericqa commented on HDFS-13441: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-18 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443349#comment-16443349 ] yunjiong zhao commented on HDFS-13441: -- [~daryn] , you are right, it's not the best and reliable way

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-18 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442824#comment-16442824 ] Daryn Sharp commented on HDFS-13441: This is a bad approach for a couple reasons. Checking if the

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-17 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16441110#comment-16441110 ] yunjiong zhao commented on HDFS-13441: -- [~hexiaoqiao], DataNode can't use NamenodeProtocol. >

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440798#comment-16440798 ] He Xiaoqiao commented on HDFS-13441: {quote}Let DataNode pull Block Key from NameNode is one choice,

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-16 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440104#comment-16440104 ] yunjiong zhao commented on HDFS-13441: -- Unit test failure is not related to this patch. > DataNode

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440080#comment-16440080 ] genericqa commented on HDFS-13441: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-16 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16439905#comment-16439905 ] yunjiong zhao commented on HDFS-13441: -- Upload HDFS-13441.002.patch, which contain unit test. >

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-16 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16439897#comment-16439897 ] yunjiong zhao commented on HDFS-13441: -- [~hexiaoqiao] , Let DataNode pull Block Key from NameNode is

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-15 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16438968#comment-16438968 ] He Xiaoqiao commented on HDFS-13441: [~zhaoyunjiong] it is my misunderstand above One minor suggestion

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-14 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16438531#comment-16438531 ] yunjiong zhao commented on HDFS-13441: -- [~hexiaoqiao] , this issue is different, it is not about DN

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16438448#comment-16438448 ] He Xiaoqiao commented on HDFS-13441: [~zhaoyunjiong], If I understand correctly, this issue was caused

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-13 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437740#comment-16437740 ] yunjiong zhao commented on HDFS-13441: -- {quote}  BlockKey is usually synchronized aggressively –

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436799#comment-16436799 ] genericqa commented on HDFS-13441: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436754#comment-16436754 ] He Xiaoqiao commented on HDFS-13441: the detailed analysis ref:

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-12 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436752#comment-16436752 ] He Xiaoqiao commented on HDFS-13441: hi [~zhaoyunjiong],[~jojochuang] we meet the similar problem in

[jira] [Commented] (HDFS-13441) DataNode missed BlockKey update from NameNode due to HeartbeatResponse was dropped

2018-04-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436649#comment-16436649 ] Wei-Chiu Chuang commented on HDFS-13441: Hi [~zhaoyunjiong] thanks for reporting the issue.