[
https://issues.apache.org/jira/browse/CASSANDRA-21408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18084095#comment-18084095
]
Dmitry Konstantinov commented on CASSANDRA-21408:
-------------------------------------------------
The same issue in another run:
* https://pre-ci.cassandra.apache.org/job/cassandra-6.0/27/
*
https://pre-ci.cassandra.apache.org/job/cassandra-6.0/27/pipeline-overview/log?nodeId=2023
> distributed.test.ShortReadProtectionTest-_jdk17_x86_64 may fail with OOM
> ------------------------------------------------------------------------
>
> Key: CASSANDRA-21408
> URL: https://issues.apache.org/jira/browse/CASSANDRA-21408
> Project: Apache Cassandra
> Issue Type: Bug
> Components: Test/dtest/java
> Reporter: Dmitry Konstantinov
> Priority: Normal
> Attachments: pre-ci_trunk_573_OOM.log
>
>
> https://pre-ci.cassandra.apache.org/job/cassandra/573/pipeline-overview/log?nodeId=3867
> {code}
> [2026-05-28T08:58:31.289Z] [junit-timeout] Testsuite:
> org.apache.cassandra.distributed.test.ShortReadProtectionTest-_jdk17_x86_64
> [2026-05-28T09:02:22.782Z] [junit-timeout] java.lang.OutOfMemoryError: Java
> heap space
> [2026-05-28T09:02:22.782Z] [junit-timeout] Dumping heap to
> /home/cassandra/cassandra/build/test/java_pid2094.hprof ...
> [2026-05-28T09:02:23.038Z] [junit-timeout] Heap dump file created [599375632
> bytes in 1.284 secs]
> {code}
> Full log (including thread dump) is in [^pre-ci_trunk_573_OOM.log]
> I see several accord threads are locked on logger logic, the lock is acquired
> by:
> {code}
> [2026-05-28T09:13:29.708Z] [junit-timeout] "node3_AccordExecutor[0,0]" #119
> prio=5 os_prio=0 cpu=1390.79ms elapsed=892.87s tid=0x00007fc6bc5cadd0
> nid=0x8ae waiting for monitor entry [0x00007fc6c1284000]
> [2026-05-28T09:13:29.708Z] [junit-timeout] java.lang.Thread.State: BLOCKED
> (on object monitor)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> java.io.PrintStream.write([email protected]/PrintStream.java:566)
> [2026-05-28T09:13:29.708Z] [junit-timeout] - waiting to lock
> <0x00000000c0aaf2c8> (a
> org.apache.cassandra.LogbackStatusListener$WrappedPrintStream)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> org.apache.cassandra.LogbackStatusListener$WrappedPrintStream.write(LogbackStatusListener.java:225)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> java.io.PrintStream.write([email protected]/PrintStream.java:616)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> ch.qos.logback.core.joran.spi.ConsoleTarget$1.write(ConsoleTarget.java:39)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> ch.qos.logback.core.OutputStreamAppender.writeByteArrayToOutputStreamWithPossibleFlush(OutputStreamAppender.java:234)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> ch.qos.logback.core.OutputStreamAppender.writeBytes(OutputStreamAppender.java:217)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> ch.qos.logback.core.OutputStreamAppender.writeOut(OutputStreamAppender.java:204)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> ch.qos.logback.core.OutputStreamAppender.subAppend(OutputStreamAppender.java:257)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> ch.qos.logback.core.OutputStreamAppender.append(OutputStreamAppender.java:111)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> ch.qos.logback.core.UnsynchronizedAppenderBase.doAppend(UnsynchronizedAppenderBase.java:85)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:51)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> ch.qos.logback.classic.Logger.appendLoopOnAppenders(Logger.java:272)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> ch.qos.logback.classic.Logger.callAppenders(Logger.java:259)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:426)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> ch.qos.logback.classic.Logger.filterAndLog_1(Logger.java:402)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> ch.qos.logback.classic.Logger.debug(Logger.java:491)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.local.durability.DurabilityService.report(DurabilityService.java:222)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.coordinate.ExecuteSyncPoint.update(ExecuteSyncPoint.java:256)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.coordinate.ExecuteSyncPoint.onSuccessInternal(ExecuteSyncPoint.java:166)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.coordinate.ExecuteSyncPoint.onSuccessInternal(ExecuteSyncPoint.java:57)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.coordinate.AbstractCoordination.onSuccessExclusive(AbstractCoordination.java:274)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.coordinate.AbstractCoordination.onSuccessExclusive(AbstractCoordination.java:59)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.messages.Callback$CallbackExclusive.lambda$onSuccess$0(Callback.java:45)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.messages.Callback$CallbackExclusive$$Lambda$7592/0x00007fc72953b7e8.run(Unknown
> Source)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> org.apache.cassandra.service.accord.AccordExecutor$SequentialExecutor.tryExecuteImmediately(AccordExecutor.java:1544)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.api.AsyncExecutor.executeMaybeImmediately(AsyncExecutor.java:45)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.messages.Callback$CallbackExclusive.onSuccess(Callback.java:44)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.coordinate.AbstractCoordination.onSuccess(AbstractCoordination.java:245)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.coordinate.AbstractCoordination.onSuccess(AbstractCoordination.java:59)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.impl.RequestCallbacks$CallbackStripe$RegisteredCallback.unsafeOnSuccess(RequestCallbacks.java:130)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.impl.RequestCallbacks$CallbackStripe.lambda$onSuccess$0(RequestCallbacks.java:204)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.impl.RequestCallbacks$CallbackStripe$$Lambda$7595/0x00007fc72953be70.accept(Unknown
> Source)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.impl.RequestCallbacks$CallbackStripe$RegisteredCallback.lambda$safeInvoke$0(RequestCallbacks.java:151)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> accord.impl.RequestCallbacks$CallbackStripe$RegisteredCallback$$Lambda$7596/0x00007fc72953c0a0.run(Unknown
> Source)
> [2026-05-28T09:13:29.708Z] [junit-timeout] at
> org.apache.cassandra.service.accord.AccordExecutor$PlainRunnable.runInternal(AccordExecutor.java:1714)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
