certara-gschaffer commented on issue #425: URL: https://github.com/apache/polaris/issues/425#issuecomment-3597983983
Openlineage recommends polling for datasource facets. https://openlineage.io/docs/integrations/about#integrating-with-data-sources in this case I would propose a cronjob like thing that collects the Facets information and sends them to a remote listener endpoint. as @collado-mike proposed Polaris would know all the information necessary from the Iceberg data. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
