anoopj commented on issue #15898: URL: https://github.com/apache/iceberg/issues/15898#issuecomment-4322288262
@boaz-gold I think the crux of the problem is that `FileTracker` is unable to close the `FileIO`. There are two possible root causes for this : 1. Something in the application is holding a strong reference to the `TableOperations`. e.g. Long running queries, or some background thread. You might be able to verify this by doing a heap dump. 2. There are no strong references to `TableOperations`, but the object got into an old gen of the heap, and that region was not collected. You can verify if this is a problem by doing a full GC and see if the SDK threads go down. So you would first do a thread count by doing `jstack <pid> | grep -c "sdk-ScheduledExecutor"`, then do trigger a full GC by doing `jcmd <pid> GC.run` and then run `jstack <pid> | grep -c "sdk-ScheduledExecutor"` again to see if the count is down. Please note that running a full GC will pause the application by a few seconds, so please be careful if you are running on a server facing user traffic. Once we know the root cause, we can then explore solutions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
