loserwang1024 opened a new issue, #2783: URL: https://github.com/apache/fluss/issues/2783
### Search before asking - [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar. ### Fluss version 0.8.0 (latest release) ### Please describe the bug 🐞 ### Problem From flink job, it shows that some remote files are downloaded even after log fetcher is closed. ``` 2026-02-25 21:03:55,147 INFO org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Closing Source Reader. 2026-02-25 21:03:55,147 INFO org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Shutting down split fetcher 0 2026-02-25 21:03:55,147 INFO org.apache.fluss.client.table.scanner.log.RemoteLogDownloader$DownloadRemoteLogThread [] - Shutting down 2026-02-25 21:03:55,148 INFO org.apache.fluss.client.table.scanner.log.RemoteLogDownloader$DownloadRemoteLogThread [] - Stopped 2026-02-25 21:03:55,148 INFO org.apache.fluss.client.table.scanner.log.RemoteLogDownloader$DownloadRemoteLogThread [] - Shutdown completed 2026-02-25 21:03:55,290 INFO org.apache.fluss.client.table.scanner.log.LogFetcher [] - Fetcher for fluss.t_zeeker_2x_realtime_signal is closed. ----------- After log fetcher is closed, still have remote file been downloaded 2026-02-25 21:03:55,338 INFO org.apache.fluss.client.table.scanner.log.RemoteLogDownloader [] - Successfully downloaded remote log segment file 913c5771-7f5d-4b70-afeb-2d0245dce1b4_00000000000099999068.log to local cost 17484 ms. 2026-02-25 21:03:55,951 INFO org.apache.fluss.client.table.scanner.log.RemoteLogDownloader [] - Successfully downloaded remote log segment file 1b0c9f4e-c536-4c79-a08f-8eee39980221_00000000000100442734.log to local cost 18082 ms. 2026-02-25 21:03:56,012 INFO org.apache.fluss.client.table.scanner.log.RemoteLogDownloader [] - Successfully downloaded remote log segment file c6b6d811-b28d-4db7-ab68-ec3d44fc75dd_00000000000100881891.log to local cost 18143 ms. ----------- 2026-02-25 21:03:56,855 INFO org.apache.fluss.rpc.netty.client.NettyClient [] - Netty client was shutdown successfully. 2026-02-25 21:03:56,858 INFO org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Split fetcher 0 exited. ``` ### Reason Currently, when close RemoteLogDownloader, remoteFileDownloader is not shutdown. ```java @Override public void close() throws IOException { try { downloadThread.shutdown(); } catch (InterruptedException e) { // ignore } deleteDirectoryQuietly(localLogDir.toFile()); } ``` That means after closing reader, still download remoteFileDownloader ### Solution shutdown remoteFileDownloader ### Are you willing to submit a PR? - [x] I'm willing to submit a PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
