[
https://issues.apache.org/jira/browse/CASSANDRA-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18114244#comment-18114244
]
Michael Semb Wever commented on CASSANDRA-21657:
------------------------------------------------
CI run on {{mck/CASSANDRA-21657/trunk}} at
[0f3f68241f31|https://github.com/thelastpickle/cassandra/commit/0f3f68241f313bb0468b34da8dee63a353de6683]
Build: [cassandra #25|https://astro-cass.ci/job/cassandra/25]
Profile: pre-commit
Result: UNSTABLE – Passed 111164 – Failed 13 – Skipped 1746 – Total 112923
Attached: [^ci_summary_thelastpickle_mck-CASSANDRA-21657-trunk_25.html] and
[^results_details_thelastpickle_mck-CASSANDRA-21657-trunk_25.tar.xz]
13 failing test(s), judged against butler
|| test || verdict || evidence ||
| {{distributed.test.accord.AccordMigrationTest.testPaxosToAccordCAS}} |
unproven | butler holds no record of this test, so the local re-run decides it |
| {{distributed.test.accord.AccordMigrationTest.testPaxosToAccordSerialRead}} |
unproven | butler holds no record of this test, so the local re-run decides it |
| {{distributed.test.accord.InteropAccordCQLTest.testCASSimulatorLite}} |
unproven | butler holds no record of this test, so the local re-run decides it |
| {{distributed.test.accord.InteropAccordCQLTest.testCASSimulatorLite}} |
unproven | butler holds no record of this test, so the local re-run decides it |
| {{distributed.test.accord.InteropAccordCQLTest.testCASSimulatorLite}} |
unproven | butler holds no record of this test, so the local re-run decides it |
| {{dtest-latest.write_failures_test.TestWriteFailures.test_counter}} |
unproven | butler holds no record of this test, so the local re-run decides it |
| {{simulator.test.AccordHarrySimulationTest.test}} | unproven | butler holds
no record of this test, so the local re-run decides it |
| {{simulator.test.EpochStressTest.manyEpochsAndAccordConverges}} | unproven |
butler holds no record of this test, so the local re-run decides it |
| {{simulator.test.ShortAccordSimulationTest.simulationTest}} | unproven |
butler holds no record of this test, so the local re-run decides it |
|
{{simulator.test.ShortPaxosSimulationTest.selfReconcileTest-cassandra.testtag_IS_UNDEFINED}}
| unproven | butler holds no record of this test, so the local re-run decides
it |
| {{simulator.test.SingleNodeSingleTableASTTest.accordFull}} | unproven |
butler holds no record of this test, so the local re-run decides it |
| {{simulator.test.SingleNodeSingleTableASTTest.accordMixedReads}} | unproven |
butler holds no record of this test, so the local re-run decides it |
| {{simulator.test.HarrySimulatorTest.test}} | known | butler links
CASSANDRA-19279 (closed) to this test |
Note: butler knows no workflow for cassandra.
> The hints write buffer is not released when the write executor shuts down
> -------------------------------------------------------------------------
>
> Key: CASSANDRA-21657
> URL: https://issues.apache.org/jira/browse/CASSANDRA-21657
> Project: Apache Cassandra
> Issue Type: Bug
> Components: Consistency/Hints
> Reporter: Michael Semb Wever
> Priority: Normal
> Fix For: 5.0.x, 6.0.x, 7.x
>
> Attachments:
> ci_summary_thelastpickle_mck-CASSANDRA-21657-5.0_22.html,
> ci_summary_thelastpickle_mck-CASSANDRA-21657-6.0_22.html,
> ci_summary_thelastpickle_mck-CASSANDRA-21657-trunk_25.html,
> results_details_thelastpickle_mck-CASSANDRA-21657-5.0_22.tar.xz,
> results_details_thelastpickle_mck-CASSANDRA-21657-6.0_22.tar.xz,
> results_details_thelastpickle_mck-CASSANDRA-21657-trunk_25.tar.xz
>
>
> {{HintsWriteExecutor}} allocates a 256 KiB direct buffer that every write
> task shares:
> {code:java}
> writeBuffer = ByteBuffer.allocateDirect(WRITE_BUFFER_SIZE);
> {code}
> {{shutdownBlocking}} shuts the executor down and leaves the buffer allocated.
> A process that shuts the hints service down and starts it again loses 256 KiB
> of direct memory each time. The in-JVM test framework does exactly that, once
> per instance restart, so a long dtest run holds direct memory that no
> instance can use.
> A node shutdown in production ends the process, so the priority is Low; the
> cost falls on the test framework and on any other caller that restarts the
> service in one process.
> The patch releases the buffer with {{FileUtils.clean}} after the executor
> terminates. The release waits for termination, because a write task that
> still runs holds the buffer, and a shutdown that gives up after its minute
> reports the buffer it keeps rather than freeing memory a task may write to.
> Patch:
> [mck/CASSANDRA-21657/5.0|https://github.com/thelastpickle/cassandra/tree/mck/CASSANDRA-21657/5.0]
> Provenance:
> [00003d27fa|https://github.com/datastax/cassandra/commit/00003d27faf2241245436d9440d740e1cd18aaa8]
> by [~jlewandowski]. That commit releases the buffer in a {{finally}} block
> and carries further work on the buffer pool and on the in-JVM instance
> shutdown, which this patch leaves out. The {{finally}} block frees the buffer
> even when a write task is still running, so this patch tests the termination
> result instead, and adds the regression test the commit lacks.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
