Guillaume Nodet created CAMEL-24018:
---------------------------------------

             Summary: Fix flaky OpensearchIndexIT - disk usage exceeded 
flood-stage watermark
                 Key: CAMEL-24018
                 URL: https://issues.apache.org/jira/browse/CAMEL-24018
             Project: Camel
          Issue Type: Bug
          Components: camel-opensearch
            Reporter: Guillaume Nodet


The {{OpensearchIndexIT}} integration test is flaky on CI. Over the last 12 
days, it shows 7 failed runs and 7 flaky runs out of 215 total runs.

All 5 test methods in the class fail with the same root cause:

{code}
cluster_block_exception: index [twitter] blocked by: [TOO_MANY_REQUESTS/12/disk 
usage exceeded flood-stage watermark, index has read-only-allow-delete block]
{code}

This happens because the OpenSearch test container disk fills up on CI machines 
with limited disk space. When disk usage exceeds the flood-stage watermark, 
OpenSearch puts all indices into read-only-allow-delete mode, causing all write 
operations to fail with 429 Too Many Requests.

The fix has two parts:
# Disable disk allocation watermarks in the OpenSearch test container 
configuration so the container never blocks writes due to disk pressure.
# Add {{@AfterEach}} cleanup in {{OpensearchIndexIT}} to delete the "twitter" 
index after each test, preventing data accumulation across tests.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to