[jira] [Commented] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13438193#comment-13438193 ] Eli Collins commented on HDFS-3803: --- Yea, now that we don't start a new period every 5 seconds it's no longer chatty even at info level. BlockPoolSliceScanner new work period notice is very chatty at INFO level - Key: HDFS-3803 URL: https://issues.apache.org/jira/browse/HDFS-3803 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 2.1.0-alpha, 2.0.1-alpha Environment: Hadoop 2.0.1-alpha-SNAPSHOT Reporter: Andrew Purtell Priority: Minor Fix For: 2.1.0-alpha, 3.0.0 Attachments: HDFS-3803.patch One line of ~140 chars logged every 5 seconds. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13435049#comment-13435049 ] Hudson commented on HDFS-3803: -- Integrated in Hadoop-Hdfs-trunk #1135 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1135/]) HDFS-3803. Change BlockPoolSliceScanner chatty INFO log to DEBUG. Contributed by Andrew Purtell (Revision 1373174) Result = FAILURE suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1373174 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockPoolSliceScanner.java BlockPoolSliceScanner new work period notice is very chatty at INFO level - Key: HDFS-3803 URL: https://issues.apache.org/jira/browse/HDFS-3803 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 2.1.0-alpha, 2.0.1-alpha Environment: Hadoop 2.0.1-alpha-SNAPSHOT Reporter: Andrew Purtell Priority: Minor Fix For: 2.1.0-alpha, 3.0.0 Attachments: HDFS-3803.patch One line of ~140 chars logged every 5 seconds. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13435078#comment-13435078 ] Hudson commented on HDFS-3803: -- Integrated in Hadoop-Mapreduce-trunk #1167 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1167/]) HDFS-3803. Change BlockPoolSliceScanner chatty INFO log to DEBUG. Contributed by Andrew Purtell (Revision 1373174) Result = FAILURE suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1373174 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockPoolSliceScanner.java BlockPoolSliceScanner new work period notice is very chatty at INFO level - Key: HDFS-3803 URL: https://issues.apache.org/jira/browse/HDFS-3803 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 2.1.0-alpha, 2.0.1-alpha Environment: Hadoop 2.0.1-alpha-SNAPSHOT Reporter: Andrew Purtell Priority: Minor Fix For: 2.1.0-alpha, 3.0.0 Attachments: HDFS-3803.patch One line of ~140 chars logged every 5 seconds. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13434690#comment-13434690 ] Suresh Srinivas commented on HDFS-3803: --- +1 for the patch. I will commit it soon. BlockPoolSliceScanner new work period notice is very chatty at INFO level - Key: HDFS-3803 URL: https://issues.apache.org/jira/browse/HDFS-3803 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 2.1.0-alpha, 2.0.1-alpha Environment: Hadoop 2.0.1-alpha-SNAPSHOT Reporter: Andrew Purtell Priority: Minor Attachments: HDFS-3803.patch One line of ~140 chars logged every 5 seconds. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13434703#comment-13434703 ] Andy Isaacson commented on HDFS-3803: - The BlockPoolScanner is supposed to be starting a new period every three weeks, not every 5 seconds. See HDFS-3194. I think this -LOG.info +LOG.debug change should be reverted and https://issues.apache.org/jira/browse/HDFS-3194?focusedCommentId=13399085page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13399085 should be merged instead. BlockPoolSliceScanner new work period notice is very chatty at INFO level - Key: HDFS-3803 URL: https://issues.apache.org/jira/browse/HDFS-3803 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 2.1.0-alpha, 2.0.1-alpha Environment: Hadoop 2.0.1-alpha-SNAPSHOT Reporter: Andrew Purtell Priority: Minor Fix For: 3.0.0 Attachments: HDFS-3803.patch One line of ~140 chars logged every 5 seconds. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13434715#comment-13434715 ] Suresh Srinivas commented on HDFS-3803: --- @Andy, I think LOG.debug seems reasonable level for it. I am not sure if this calls for a revert. I will look at HDFS-3194. BlockPoolSliceScanner new work period notice is very chatty at INFO level - Key: HDFS-3803 URL: https://issues.apache.org/jira/browse/HDFS-3803 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 2.1.0-alpha, 2.0.1-alpha Environment: Hadoop 2.0.1-alpha-SNAPSHOT Reporter: Andrew Purtell Priority: Minor Fix For: 2.1.0-alpha, 3.0.0 Attachments: HDFS-3803.patch One line of ~140 chars logged every 5 seconds. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13434723#comment-13434723 ] Suresh Srinivas commented on HDFS-3803: --- bq. Please revert this change and review HDFS-3194. Not sure if you saw my previous comment. Debug level seems reasonable for that log. Do you disagree. I will get to HDFS-3194 as soon as I can. BlockPoolSliceScanner new work period notice is very chatty at INFO level - Key: HDFS-3803 URL: https://issues.apache.org/jira/browse/HDFS-3803 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 2.1.0-alpha, 2.0.1-alpha Environment: Hadoop 2.0.1-alpha-SNAPSHOT Reporter: Andrew Purtell Priority: Minor Fix For: 2.1.0-alpha, 3.0.0 Attachments: HDFS-3803.patch One line of ~140 chars logged every 5 seconds. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13434724#comment-13434724 ] Andy Isaacson commented on HDFS-3803: - bq. LOG.debug seems reasonable level for it. I disagree, without the Starting a new period message it's very difficult to diagnose the block pool scanner in production scenarios. Production cannot run with debug enabled due to other cases where debug logging is actually expensive. So making this critical status message a LOG.debug makes it effectively useless. I'd be OK with replacing all of these logs with a useful set of (for example) JMX metrics so that the scanner is more observable in an automatable/graphable fashion, but until that happens, this message needs to stay in at LOG.info. BlockPoolSliceScanner new work period notice is very chatty at INFO level - Key: HDFS-3803 URL: https://issues.apache.org/jira/browse/HDFS-3803 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 2.1.0-alpha, 2.0.1-alpha Environment: Hadoop 2.0.1-alpha-SNAPSHOT Reporter: Andrew Purtell Priority: Minor Fix For: 2.1.0-alpha, 3.0.0 Attachments: HDFS-3803.patch One line of ~140 chars logged every 5 seconds. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13434728#comment-13434728 ] Andrew Purtell commented on HDFS-3803: -- If the default period is supposed to be 3 weeks, then this message wouldn't represent the large fraction of log (therefore low S/N) as current. Whatever. BlockPoolSliceScanner new work period notice is very chatty at INFO level - Key: HDFS-3803 URL: https://issues.apache.org/jira/browse/HDFS-3803 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 2.1.0-alpha, 2.0.1-alpha Environment: Hadoop 2.0.1-alpha-SNAPSHOT Reporter: Andrew Purtell Priority: Minor Fix For: 2.1.0-alpha, 3.0.0 Attachments: HDFS-3803.patch One line of ~140 chars logged every 5 seconds. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13434732#comment-13434732 ] Suresh Srinivas commented on HDFS-3803: --- bq. I disagree, without the Starting a new period message it's very difficult to diagnose the block pool scanner in production scenarios. Let me know what production scenario you have in mind. Debug logs should be the last resort for this kind of debugging. For thread related issues one can look at java stack. I agree we should do it with metrics. Currently this log is an annoyance. When HDFS-3194 goes in we can undo this change. BlockPoolSliceScanner new work period notice is very chatty at INFO level - Key: HDFS-3803 URL: https://issues.apache.org/jira/browse/HDFS-3803 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 2.1.0-alpha, 2.0.1-alpha Environment: Hadoop 2.0.1-alpha-SNAPSHOT Reporter: Andrew Purtell Priority: Minor Fix For: 2.1.0-alpha, 3.0.0 Attachments: HDFS-3803.patch One line of ~140 chars logged every 5 seconds. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13434734#comment-13434734 ] Hudson commented on HDFS-3803: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2603 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2603/]) HDFS-3803. Change BlockPoolSliceScanner chatty INFO log to DEBUG. Contributed by Andrew Purtell (Revision 1373174) Result = FAILURE suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1373174 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockPoolSliceScanner.java BlockPoolSliceScanner new work period notice is very chatty at INFO level - Key: HDFS-3803 URL: https://issues.apache.org/jira/browse/HDFS-3803 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 2.1.0-alpha, 2.0.1-alpha Environment: Hadoop 2.0.1-alpha-SNAPSHOT Reporter: Andrew Purtell Priority: Minor Fix For: 2.1.0-alpha, 3.0.0 Attachments: HDFS-3803.patch One line of ~140 chars logged every 5 seconds. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13434775#comment-13434775 ] Hudson commented on HDFS-3803: -- Integrated in Hadoop-Common-trunk-Commit #2578 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2578/]) HDFS-3803. Change BlockPoolSliceScanner chatty INFO log to DEBUG. Contributed by Andrew Purtell (Revision 1373174) Result = SUCCESS suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1373174 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockPoolSliceScanner.java BlockPoolSliceScanner new work period notice is very chatty at INFO level - Key: HDFS-3803 URL: https://issues.apache.org/jira/browse/HDFS-3803 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 2.1.0-alpha, 2.0.1-alpha Environment: Hadoop 2.0.1-alpha-SNAPSHOT Reporter: Andrew Purtell Priority: Minor Fix For: 2.1.0-alpha, 3.0.0 Attachments: HDFS-3803.patch One line of ~140 chars logged every 5 seconds. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13434779#comment-13434779 ] Hudson commented on HDFS-3803: -- Integrated in Hadoop-Hdfs-trunk-Commit #2643 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2643/]) HDFS-3803. Change BlockPoolSliceScanner chatty INFO log to DEBUG. Contributed by Andrew Purtell (Revision 1373174) Result = SUCCESS suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1373174 Files : * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockPoolSliceScanner.java BlockPoolSliceScanner new work period notice is very chatty at INFO level - Key: HDFS-3803 URL: https://issues.apache.org/jira/browse/HDFS-3803 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 2.1.0-alpha, 2.0.1-alpha Environment: Hadoop 2.0.1-alpha-SNAPSHOT Reporter: Andrew Purtell Priority: Minor Fix For: 2.1.0-alpha, 3.0.0 Attachments: HDFS-3803.patch One line of ~140 chars logged every 5 seconds. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13434789#comment-13434789 ] Uma Maheswara Rao G commented on HDFS-3803: --- Linked this issue to HDFS-3194, reasonable to undo this once HDFS-3194 goes in. (Actually HDFS-3194 addressing one more potential issue, that will be bit serious than this. But observation of that issue comes from this logs. Most of the times we will run with INFO logs only. If we change that to DEBUG, we would have missed that actual potential issue...More details on HDFS-3194) Need to check, because of this change whether that patch going stale and need to regenerate again. BlockPoolSliceScanner new work period notice is very chatty at INFO level - Key: HDFS-3803 URL: https://issues.apache.org/jira/browse/HDFS-3803 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 2.1.0-alpha, 2.0.1-alpha Environment: Hadoop 2.0.1-alpha-SNAPSHOT Reporter: Andrew Purtell Priority: Minor Fix For: 2.1.0-alpha, 3.0.0 Attachments: HDFS-3803.patch One line of ~140 chars logged every 5 seconds. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
