pvary commented on PR #17980: URL: https://github.com/apache/iceberg/pull/17980#issuecomment-5568783921
The issue is that the Flink writers need to create new files periodically. They called `table.io()` to create new data files. Before introducing `tableSupplier.get().io()` and `table-refresh-interval` the writers simply reused the table object created at startup. The credentials are eventually timed out and the job was not able to write data anymore. I still think we should use something like https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/security/security-delegation-token/ for these cases Also, until we have a good solution, adding a DOCKER tests just for testing something with REST catalogs seems like an overkill -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
