[
https://issues.apache.org/jira/browse/KAFKA-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15340668#comment-15340668
]
Guozhang Wang commented on KAFKA-3872:
--------------------------------------
I think we should reduce the {{LogCleanerDedupeBufferSize}} from the default
128Mb, since each integration test will allocate this amount of memory for each
log cleaner thread. Thoughts [~enothereska]?
> OOM while running Kafka Streams integration tests
> -------------------------------------------------
>
> Key: KAFKA-3872
> URL: https://issues.apache.org/jira/browse/KAFKA-3872
> Project: Kafka
> Issue Type: Sub-task
> Components: streams, unit tests
> Reporter: Ismael Juma
> Assignee: Guozhang Wang
> Labels: transient-unit-test-failure
>
> Failures:
> org.apache.kafka.streams.integration.FanoutIntegrationTest.classMethod
> org.apache.kafka.streams.integration.WordCountIntegrationTest.classMethod
> Stracktrace:
> {code}
> java.lang.OutOfMemoryError: Java heap space
> at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
> at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
> at kafka.log.SkimpyOffsetMap.<init>(OffsetMap.scala:43)
> at kafka.log.LogCleaner$CleanerThread.<init>(LogCleaner.scala:193)
> at kafka.log.LogCleaner$$anonfun$1.apply(LogCleaner.scala:83)
> at kafka.log.LogCleaner$$anonfun$1.apply(LogCleaner.scala:83)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
> at scala.collection.immutable.Range.foreach(Range.scala:141)
> at scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
> at scala.collection.AbstractTraversable.map(Traversable.scala:105)
> at kafka.log.LogCleaner.<init>(LogCleaner.scala:83)
> at kafka.log.LogManager.<init>(LogManager.scala:66)
> at kafka.server.KafkaServer.createLogManager(KafkaServer.scala:609)
> at kafka.server.KafkaServer.startup(KafkaServer.scala:183)
> at kafka.utils.TestUtils$.createServer(TestUtils.scala:132)
> at kafka.utils.TestUtils.createServer(TestUtils.scala)
> at
> org.apache.kafka.streams.integration.utils.KafkaEmbedded.<init>(KafkaEmbedded.java:79)
> at
> org.apache.kafka.streams.integration.utils.EmbeddedSingleNodeKafkaCluster.start(EmbeddedSingleNodeKafkaCluster.java:54)
> at
> {code}
> Two builds:
> https://builds.apache.org/job/kafka-trunk-jdk8/704/
> https://builds.apache.org/job/kafka-trunk-jdk8/705
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
