[
https://issues.apache.org/jira/browse/KAFKA-13597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478270#comment-17478270
]
Luke Chen commented on KAFKA-13597:
-----------------------------------
Good to hear that! Thank you for following up!
> Memory leak with kafka-clients 3.0.0
> ------------------------------------
>
> Key: KAFKA-13597
> URL: https://issues.apache.org/jira/browse/KAFKA-13597
> Project: Kafka
> Issue Type: Bug
> Components: clients
> Affects Versions: 3.0.0
> Reporter: Willian Dallastella
> Priority: Major
> Attachments: image-2022-01-17-12-59-43-411.png,
> image-2022-01-17-13-01-43-418.png
>
>
> I'm having this issue reported here:
> [https://github.com/spring-projects/spring-kafka/issues/2056]
>
> It is a Spring Boot 2.5.7 application that started failing (out of memory)
> when updated to Spring Boot 2.6.1.
> This updated *kafka-clients {color:#00875a}2.7.1{color}* to
> *{color:#ff0000}3.0.0{color}* and started causing the memory leak.
>
> The service is using a standard spring *katkaTemplate* to send messages.
> {code:java}
> kafkaTemplate.send(
> topic,
> id,
> data
> ).addCallback(kafkaLoggerCallback) {code}
> This producer is quite heavy (~2.5k messages/s).
> My kafka config:
> {code:java}
> spring:
> kafka:
> bootstrap-servers:
> - my_kafka_host:9092
> properties:
> client.id: my_client_id
> ssl.endpoint.identification.algorithm: https
> request.timeout.ms: 20000
> retry.backoff.ms: 500
> sasl.jaas.config:
> org.apache.kafka.common.security.plain.PlainLoginModule required
> username="my_user" password="my_password";
> security.protocol: SASL_SSL
> sasl.mechanism: PLAIN
> interceptor.classes:
> io.confluent.monitoring.clients.interceptor.MonitoringProducerInterceptor
> confluent.monitoring.interceptor.sasl.mechanism: PLAIN
> confluent.monitoring.interceptor.security.protocol: SASL_SSL
> confluent.monitoring.interceptor.sasl.jaas.config:
> org.apache.kafka.common.security.plain.PlainLoginModule required
> username="my_user" password="my_password";
> schema.registry.basic.auth.user.info: sr_ccloud_key:sr_ccloud_key
> schema.registry.url: https://my_schema_registry
> ack: 1
> producer:
> key-serializer: io.confluent.kafka.serializers.KafkaAvroSerializer
> value-serializer: io.confluent.kafka.serializers.KafkaAvroSerializer
> {code}
>
> *Downgrading* just the lib *kafka-clients* to *{color:#00875a}2.7.1{color}*
> or *{color:#00875a}2.8.1{color}* solves the issue.
> h2. Memory leak sample
> * The green line around 16:40 is the service using kafka-clients 2.7.1
> * The pink line around 16:55 is without downgrading, that means
> kafka-clients 3.0.0
> !image-2022-01-17-12-59-43-411.png|width=1017,height=303!
>
> h2. Profiling sample
>
> !image-2022-01-17-13-01-43-418.png!
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
