[
https://issues.apache.org/jira/browse/KAFKA-1122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987452#comment-13987452
]
Jim Hoagland commented on KAFKA-1122:
-------------------------------------
There is certainly a use case for manually scanning over logs. However, at a
certain point relying solely visually looking over logs becomes inefficient or
non-scable. This suggest that there is a use case for automation to look over
the logs. The question is how to support both.
I would suggest making the log format friendly to scripting/automation. We
could then also provide a tool which presents the logs in a human-friendly
manner (even something a simple as a specialized "cat" program). This provides
good support for both use cases. However, if the log format is not friendly to
automation then that use case is harder to support.
> Kafka can log giant log lines
> -----------------------------
>
> Key: KAFKA-1122
> URL: https://issues.apache.org/jira/browse/KAFKA-1122
> Project: Kafka
> Issue Type: Bug
> Affects Versions: 0.8.0
> Reporter: Jason Rosenberg
> Priority: Minor
>
> There are a number of log lines that the kafka server, and high-level
> consumer, can log, that can end up becoming a giant log line. This can be
> cumbersome to deal with in a log file.
> This happens in my case as I have have a large number of topics (on the order
> of 500-700 topics). Typically, these giant log lines will say something
> separately about every topic on the broker. An example:
> 2013-11-04 23:28:11,148 INFO [kafka-request-handler-0] server.ReplicaManager
> - [Replica Manager on Broker 10]: Handling LeaderAndIsr request
> Name:LeaderAndIsrRequest;Version:0;Controller:11;ControllerEpoch:220;CorrelationId:5;ClientId:id_11-host_null-port_27330;PartitionState:(mytopic,0)
> ->
> (LeaderAndIsrInfo:(Leader:11,ISR:11,LeaderEpoch:43,ControllerEpoch:219),ReplicationFactor:2),.....
> Imagine that line going on with a separate entry for 700 topics. There are
> many other examples of this phenomenon in the server, and high-level consumer.
> I'd think these log lines could be separated into a single line per topic.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
