stankiewicz commented on PR #38149:
URL: https://github.com/apache/beam/pull/38149#issuecomment-4238248305
hey,
I understand the need to close the catalog.
Doing it per bundle is an overkill, especially if for each bundle there are
many tables to write to, catalog will waste plenty of time on loading table
credentials.
Not doing it at all, especially with dynamic destinations and with vended
credentials, fileIOTracker will grow without limits and we may constantly
refresh credentials for tables that we don't need credentials anymore.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
