[
https://issues.apache.org/jira/browse/KAFKA-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305966#comment-14305966
]
Steven Zhen Wu edited comment on KAFKA-1919 at 2/4/15 9:12 PM:
---------------------------------------------------------------
this is the producer metrics at the beginning of the test. it's all idle.
{code}
main 13:06:54,212 INFO EmptyTopicTest:52 - [request-latency-avg] NaN
main 13:06:54,213 INFO EmptyTopicTest:52 - [outgoing-byte-rate] NaN
main 13:06:54,213 INFO EmptyTopicTest:52 - [batch-size-avg] NaN
main 13:06:54,213 INFO EmptyTopicTest:52 - [connection-close-rate] NaN
main 13:06:54,213 INFO EmptyTopicTest:52 - [record-size-max] -Infinity
main 13:06:54,214 INFO EmptyTopicTest:52 - [waiting-threads] 0.0
main 13:06:54,214 INFO EmptyTopicTest:52 - [record-queue-time-avg] NaN
main 13:06:54,214 INFO EmptyTopicTest:52 - [connection-count] 0.0
main 13:06:54,215 INFO EmptyTopicTest:52 - [metadata-age] 120.032
main 13:06:54,215 INFO EmptyTopicTest:52 - [request-size-max] -Infinity
main 13:06:54,215 INFO EmptyTopicTest:52 - [records-per-request-avg] NaN
main 13:06:54,216 INFO EmptyTopicTest:52 - [record-retry-rate] NaN
main 13:06:54,216 INFO EmptyTopicTest:52 - [record-send-rate] NaN
main 13:06:54,216 INFO EmptyTopicTest:52 - [buffer-total-bytes] 3.3554432E7
main 13:06:54,216 INFO EmptyTopicTest:52 - [network-io-rate] NaN
main 13:06:54,217 INFO EmptyTopicTest:52 - [response-rate] NaN
main 13:06:54,217 INFO EmptyTopicTest:52 - [io-wait-time-ns-avg] NaN
main 13:06:54,217 INFO EmptyTopicTest:52 - [compression-rate-avg] NaN
main 13:06:54,217 INFO EmptyTopicTest:52 - [incoming-byte-rate] NaN
main 13:06:54,217 INFO EmptyTopicTest:52 - [bufferpool-wait-ratio] NaN
main 13:06:54,218 INFO EmptyTopicTest:52 - [connection-creation-rate] NaN
main 13:06:54,218 INFO EmptyTopicTest:52 - [buffer-available-bytes] 3.3554432E7
main 13:06:54,218 INFO EmptyTopicTest:52 - [record-queue-time-max] -Infinity
main 13:06:54,218 INFO EmptyTopicTest:52 - [record-size-avg] NaN
main 13:06:54,219 INFO EmptyTopicTest:52 - [record-error-rate] NaN
main 13:06:54,219 INFO EmptyTopicTest:52 - [request-latency-max] -Infinity
main 13:06:54,219 INFO EmptyTopicTest:52 - [request-rate] NaN
main 13:06:54,219 INFO EmptyTopicTest:52 - [batch-size-max] -Infinity
main 13:06:54,220 INFO EmptyTopicTest:52 - [io-time-ns-avg] NaN
main 13:06:54,220 INFO EmptyTopicTest:52 - [select-rate] NaN
main 13:06:54,220 INFO EmptyTopicTest:52 - [io-ratio] NaN
main 13:06:54,220 INFO EmptyTopicTest:52 - [requests-in-flight] 0.0
main 13:06:54,220 INFO EmptyTopicTest:52 - [io-wait-ratio] NaN
main 13:06:54,221 INFO EmptyTopicTest:52 - [request-size-avg] NaN
{code}
was (Author: stevenz3wu):
this is the producer metrics at the beginning of the test. it's all idle.
main 13:06:54,212 INFO EmptyTopicTest:52 - [request-latency-avg] NaN
main 13:06:54,213 INFO EmptyTopicTest:52 - [outgoing-byte-rate] NaN
main 13:06:54,213 INFO EmptyTopicTest:52 - [batch-size-avg] NaN
main 13:06:54,213 INFO EmptyTopicTest:52 - [connection-close-rate] NaN
main 13:06:54,213 INFO EmptyTopicTest:52 - [record-size-max] -Infinity
main 13:06:54,214 INFO EmptyTopicTest:52 - [waiting-threads] 0.0
main 13:06:54,214 INFO EmptyTopicTest:52 - [record-queue-time-avg] NaN
main 13:06:54,214 INFO EmptyTopicTest:52 - [connection-count] 0.0
main 13:06:54,215 INFO EmptyTopicTest:52 - [metadata-age] 120.032
main 13:06:54,215 INFO EmptyTopicTest:52 - [request-size-max] -Infinity
main 13:06:54,215 INFO EmptyTopicTest:52 - [records-per-request-avg] NaN
main 13:06:54,216 INFO EmptyTopicTest:52 - [record-retry-rate] NaN
main 13:06:54,216 INFO EmptyTopicTest:52 - [record-send-rate] NaN
main 13:06:54,216 INFO EmptyTopicTest:52 - [buffer-total-bytes] 3.3554432E7
main 13:06:54,216 INFO EmptyTopicTest:52 - [network-io-rate] NaN
main 13:06:54,217 INFO EmptyTopicTest:52 - [response-rate] NaN
main 13:06:54,217 INFO EmptyTopicTest:52 - [io-wait-time-ns-avg] NaN
main 13:06:54,217 INFO EmptyTopicTest:52 - [compression-rate-avg] NaN
main 13:06:54,217 INFO EmptyTopicTest:52 - [incoming-byte-rate] NaN
main 13:06:54,217 INFO EmptyTopicTest:52 - [bufferpool-wait-ratio] NaN
main 13:06:54,218 INFO EmptyTopicTest:52 - [connection-creation-rate] NaN
main 13:06:54,218 INFO EmptyTopicTest:52 - [buffer-available-bytes] 3.3554432E7
main 13:06:54,218 INFO EmptyTopicTest:52 - [record-queue-time-max] -Infinity
main 13:06:54,218 INFO EmptyTopicTest:52 - [record-size-avg] NaN
main 13:06:54,219 INFO EmptyTopicTest:52 - [record-error-rate] NaN
main 13:06:54,219 INFO EmptyTopicTest:52 - [request-latency-max] -Infinity
main 13:06:54,219 INFO EmptyTopicTest:52 - [request-rate] NaN
main 13:06:54,219 INFO EmptyTopicTest:52 - [batch-size-max] -Infinity
main 13:06:54,220 INFO EmptyTopicTest:52 - [io-time-ns-avg] NaN
main 13:06:54,220 INFO EmptyTopicTest:52 - [select-rate] NaN
main 13:06:54,220 INFO EmptyTopicTest:52 - [io-ratio] NaN
main 13:06:54,220 INFO EmptyTopicTest:52 - [requests-in-flight] 0.0
main 13:06:54,220 INFO EmptyTopicTest:52 - [io-wait-ratio] NaN
main 13:06:54,221 INFO EmptyTopicTest:52 - [request-size-avg] NaN
> Metadata request issued with no backoff in new producer if there are no topics
> ------------------------------------------------------------------------------
>
> Key: KAFKA-1919
> URL: https://issues.apache.org/jira/browse/KAFKA-1919
> Project: Kafka
> Issue Type: Bug
> Affects Versions: 0.8.2
> Reporter: Jay Kreps
>
> Original report:
> We have observed high cpu and high network traffic problem when
> 1) cluster (0.8.1.1) has no topic
> 2) KafkaProducer (0.8.2-beta) object is created without sending any traffic
> We have observed such problem twice. In both cases, problem went away
> immediately after one/any topic is created.
> Is this a known issue? Just want to check with the community first before I
> spend much time to reproduce it.
> I couldn't reproduce the issue with similar setup with unit test code in
> IDE. start two brokers with no topic locally on my laptop. create a
> KafkaProducer object without sending any msgs. but I only tested with
> 0.8.2-beta for both broker and producer.
> Issue exists in 0.8.2 as well:
> I have re-run my unit test with 0.8.2.0. same tight-loop problem happened
> after a few mins.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
