alamb commented on issue #970: URL: https://github.com/apache/arrow-datafusion/issues/970#issuecomment-948480438
> On top of that, we also need a way to let the planner know what compute plan nodes are supported by a particular database type. I think the table provider could be a good abstraction to provide this info. That is a good point. I guess I was saying that trying to encode the wonderful complexity of many different external databases into `TableProvider` seems like it will be challenging. I was wondering if perhaps mapping information like `"table B" --> "AWS posgres"` and `"table C" --> "GCP posgres"` could also be maintained outside of the `TableProvider` My concern with making additional changes to `TableProvider` is that it is fairly complicated already, so trying to encapsulate complexity elsewhere in the system might be a good idea. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
