Tao Chen created KAFKA-9151: ------------------------------- Summary: KafkaProducer.send should warmup metadata information when application starts Key: KAFKA-9151 URL: https://issues.apache.org/jira/browse/KAFKA-9151 Project: Kafka Issue Type: Improvement Components: producer Reporter: Tao Chen
When application restarts, the performance of KafkaProducer.send is slow due to metadata not available. We know that it is an old topic that whether should wait for metadata update or not. "Some user may still want to wait for a configurable amount of time on producer.send() if the queue is full instead of dropping messages immedidately. Users who want complete non-blocking producer.send() can set max.block.ms to 0." If max.block.ms is to 0, these messages can not be send successfully due to metadata not available. We have to restore these messages and try again when metadata is available, which brings much extra effect. Is it possible to provide a startup hook for users to warmup the metadata when application starts. Only after the metadata is available, application starts to work accordingly. -- This message was sent by Atlassian Jira (v8.3.4#803005)