[jira] [Commented] (HDFS-5180) Add time taken to process the command to audit log
[
https://issues.apache.org/jira/browse/HDFS-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802453#comment-13802453
]
Hadoop QA commented on HDFS-5180:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12609752/HDFS-5180.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/5256//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/5256//console
This message is automatically generated.
Add time taken to process the command to audit log
--
Key: HDFS-5180
URL: https://issues.apache.org/jira/browse/HDFS-5180
Project: Hadoop HDFS
Issue Type: Improvement
Components: namenode
Affects Versions: 3.0.0
Reporter: Shinichi Yamashita
Assignee: Shinichi Yamashita
Attachments: HDFS-5180.patch, HDFS-5180.patch
Command and ugi are output now by audit log of NameNode. But it is not output
for the processing time of command to audit log.
For example, we must check which command is a problem when a trouble such as
the slow down occurred in NameNode.
It should add the processing time to audit log to know the abnormal sign.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HDFS-5180) Add time taken to process the command to audit log
[
https://issues.apache.org/jira/browse/HDFS-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786828#comment-13786828
]
Hadoop QA commented on HDFS-5180:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12606938/HDFS-5180.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-common-project/hadoop-common.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/5103//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/5103//console
This message is automatically generated.
Add time taken to process the command to audit log
--
Key: HDFS-5180
URL: https://issues.apache.org/jira/browse/HDFS-5180
Project: Hadoop HDFS
Issue Type: Improvement
Components: namenode
Affects Versions: 3.0.0
Reporter: Shinichi Yamashita
Attachments: HDFS-5180.patch
Command and ugi are output now by audit log of NameNode. But it is not output
for the processing time of command to audit log.
For example, we must check which command is a problem when a trouble such as
the slow down occurred in NameNode.
It should add the processing time to audit log to know the abnormal sign.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HDFS-5180) Add time taken to process the command to audit log
[ https://issues.apache.org/jira/browse/HDFS-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13764889#comment-13764889 ] Shinichi Yamashita commented on HDFS-5180: -- Thank you for your comment. As you said, the check in the RPC layer is good. And it should output a request of the long processing time. I consider whether I implement it in RPC layer. Add time taken to process the command to audit log -- Key: HDFS-5180 URL: https://issues.apache.org/jira/browse/HDFS-5180 Project: Hadoop HDFS Issue Type: Improvement Components: namenode Affects Versions: 3.0.0 Reporter: Shinichi Yamashita Command and ugi are output now by audit log of NameNode. But it is not output for the processing time of command to audit log. For example, we must check which command is a problem when a trouble such as the slow down occurred in NameNode. It should add the processing time to audit log to know the abnormal sign. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-5180) Add time taken to process the command to audit log
[ https://issues.apache.org/jira/browse/HDFS-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13763663#comment-13763663 ] Todd Lipcon commented on HDFS-5180: --- I don't know that the audit log is the right place for this type of information. I'd rather see a separate slow RPC log implemented -- HBase has a function like this and it has been helpful for troubleshooting places where high latency spikes happen. Putting it at the RPC layer also helps because you can take into account queueTime separately than processingTime, and handle it generically for all services rather than having to hook into each audit event. Add time taken to process the command to audit log -- Key: HDFS-5180 URL: https://issues.apache.org/jira/browse/HDFS-5180 Project: Hadoop HDFS Issue Type: Improvement Components: namenode Affects Versions: 3.0.0 Reporter: Shinichi Yamashita Command and ugi are output now by audit log of NameNode. But it is not output for the processing time of command to audit log. For example, we must check which command is a problem when a trouble such as the slow down occurred in NameNode. It should add the processing time to audit log to know the abnormal sign. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
