anoopj commented on issue #15898: URL: https://github.com/apache/iceberg/issues/15898#issuecomment-4276426404
The original version of #15910 unconditionally [closed](https://github.com/apache/iceberg/pull/15910/changes/adc2033be7b4612eabd79b4cf0d1cca002ab0c49#r3061553449) the fileIO and would break several existing catalogs that shares the file IO. I recognize your production problem is real, but I think we need to pursue a correct fix that does not break other catalogs. One way to fix this is to add a method to catalog to clean up an expired table. A catalog implementation knows whether they are reusing fileIO, so they can make the correct decision. Downside is that this is a new API. Another option is to do some sort of refcount inside `CachingCatalog` - it would be a self contained change, but needs to be designed carefully. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
