[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2014-02-18 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904144#comment-13904144 ] Lars Francke commented on HDFS-5225: We're running CDH 4.5.0 which is using Hadoop 2.0.

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2014-02-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904121#comment-13904121 ] Kihwal Lee commented on HDFS-5225: -- [~lars_francke], what is the version of Hadoop you are

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2014-02-17 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13903144#comment-13903144 ] Lars Francke commented on HDFS-5225: We're being hit by this issue at the moment. I did

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-27 Thread Roman Shaposhnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780611#comment-13780611 ] Roman Shaposhnik commented on HDFS-5225: Once this shows up in the branch for beta

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780501#comment-13780501 ] Tsuyoshi OZAWA commented on HDFS-5225: -- [~kihwal], thanks for the explanation. The poi

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780396#comment-13780396 ] Kihwal Lee commented on HDFS-5225: -- In HDFS-5031, Vinay explained, bq. BlockScanInfo.equa

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780358#comment-13780358 ] Kihwal Lee commented on HDFS-5225: -- Due to HDFS-4797, two BlockScanInfo for different bloc

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780220#comment-13780220 ] Tsuyoshi OZAWA commented on HDFS-5225: -- [~djp], OK. But the current patch for reproduc

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780209#comment-13780209 ] Tsuyoshi OZAWA commented on HDFS-5225: -- Thank you for your investigating, Kihwal! Now

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13779241#comment-13779241 ] Kihwal Lee commented on HDFS-5225: -- The scan spins because getEarliestScanTime() will retu

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13779200#comment-13779200 ] Kihwal Lee commented on HDFS-5225: -- I took a heap dump of a data node with this problem. I

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778879#comment-13778879 ] Kihwal Lee commented on HDFS-5225: -- I am seeing cases of repeated logging of "Verification

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778534#comment-13778534 ] Junping Du commented on HDFS-5225: -- Hi [~ozawa], thanks for the patch! Besides fixing test

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778181#comment-13778181 ] Hadoop QA commented on HDFS-5225: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-23 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13775924#comment-13775924 ] Tsuyoshi OZAWA commented on HDFS-5225: -- {quote} Note that this may be not complete: I'

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13771699#comment-13771699 ] Junping Du commented on HDFS-5225: -- Hi Tsuyoshi, I think this fix may also work as this is

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13771542#comment-13771542 ] Tsuyoshi OZAWA commented on HDFS-5225: -- >> verifyFirstBlock method refers blockInfoSet

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13771538#comment-13771538 ] Tsuyoshi OZAWA commented on HDFS-5225: -- Colin and Roman, thank you for sharing! I und

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13771520#comment-13771520 ] Junping Du commented on HDFS-5225: -- Hi Colin and Roman, I think the following code won't d

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13771499#comment-13771499 ] Colin Patrick McCabe commented on HDFS-5225: It's not a log4j problem. The pro

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-18 Thread Roman Shaposhnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13771422#comment-13771422 ] Roman Shaposhnik commented on HDFS-5225: The problem here is really not log overflo

[jira] [Commented] (HDFS-5225) datanode keeps logging the same 'is no longer in the dataset' message over and over again

2013-09-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13771417#comment-13771417 ] Tsuyoshi OZAWA commented on HDFS-5225: -- Which should we dealing with this problem by,