[ https://issues.apache.org/jira/browse/KAFKA-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152413#comment-16152413 ]
Ismael Juma commented on KAFKA-5814: ------------------------------------ See KAFKA-5470. > java.lang.OutOfMemoryError: Direct buffer memory > ------------------------------------------------ > > Key: KAFKA-5814 > URL: https://issues.apache.org/jira/browse/KAFKA-5814 > Project: Kafka > Issue Type: Bug > Components: core > Reporter: Alexander Petrovsky > > Hello! > We have in our production > - kafka_2.12-0.10.2.1 > - # java -version > openjdk version "1.8.0_131" > OpenJDK Runtime Environment (build 1.8.0_131-b12) > OpenJDK 64-Bit Server VM (build 25.131-b12, mixed mode) > And we had strange behavior with kafka which result to big outage: > {code:java} > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: [2017-08-30 > 21:17:19,266] ERROR Processor got uncaught exception. > (kafka.network.Processor) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: > java.lang.OutOfMemoryError: Direct buffer memory > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > java.nio.Bits.reserveMemory(Bits.java:694) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > sun.nio.ch.Util.getTemporaryDirectBuffer(Util.java:241) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > sun.nio.ch.IOUtil.read(IOUtil.java:195) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > org.apache.kafka.common.network.PlaintextTransportLayer.read(PlaintextTransportLayer.java:110) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:97) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:71) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:169) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:150) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:355) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > org.apache.kafka.common.network.Selector.poll(Selector.java:303) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > kafka.network.Processor.poll(SocketServer.scala:494) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > kafka.network.Processor.run(SocketServer.scala:432) > авг 30 21:17:19 2kafka01.rtty.in kafka-server-start.sh[97716]: at > java.lang.Thread.run(Thread.java:748) > {code} > Only kafka cluster restart helps to fix this problem. > I wonder, why this problem have take a place, cause we running kafka with > follow options Environment="KAFKA_HEAP_OPTS=-Xmx5G -Xms5G > -XX:MaxDirectMemorySize=2G" -- This message was sent by Atlassian JIRA (v6.4.14#64029)