Wenjin Xie created FLINK-41461:
----------------------------------

             Summary: Remove outdated Ryuk image overrides in Elasticsearch 
connector tests
                 Key: FLINK-41461
                 URL: https://issues.apache.org/jira/browse/FLINK-41461
             Project: Flink
          Issue Type: Bug
          Components: Connectors / ElasticSearch
            Reporter: Wenjin Xie
            Assignee: Wenjin Xie


The ES7 and ES8 test resources pin ryuk.container.image to 
testcontainers/ryuk:0.6.0. This overrides the Ryuk 0.14.0 bundled with 
Testcontainers 2.0.5.

The main-branch CI failed while pulling Elasticsearch 8.19.0, with 'lease does 
not exist' and 'failed commit ... rename ... no such file or directory':
https://github.com/apache/flink-connector-elasticsearch/actions/runs/43178939508/job/131049883941

The errors match the concurrent image-prune/pull issue tracked in 
https://github.com/moby/moby/issues/53321. Ryuk 0.6.0 calls ImagesPrune, while 
newer Ryuk versions remove matching images individually via ImageRemove. The 
exact cleanup caller in this failed run has not been confirmed.

Remove the two testcontainers.properties files, which contain only this 
override, and use the Ryuk version bundled with Testcontainers. Keep test 
parallelism and automatic cleanup unchanged.

Validation: the full fork CI passed on JDK 11, 17 and 21 with Docker 29.4.2. 
Logs confirm Ryuk 0.14.0, successful ES7/ES8 vector-search tests and E2E tests, 
and no recurrence of the reported pull errors in this run.
https://github.com/wenjin272/flink-connector-elasticsearch/actions/runs/43190887844

Ryuk cleanup implementation:
https://github.com/testcontainers/moby-ryuk/blob/0.14.0/reaper.go#L694



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

Reply via email to