chenkovsky opened a new pull request, #14057: URL: https://github.com/apache/datafusion/pull/14057
## Which issue does this PR close? Closes #13975. ## Rationale for this change many databases support pseudo columns, for example, file_path, file_name, file_size, rowid. for pseudo columns, we don't want to get them by default, but we want to be able to use them explicitly. for the database that supports rowid. `select * from tb` won't return rowid. but we can get rowid by `select rowid, * from tb`. spark has already supported metadata columns. this PR want to support it in datafusion. ## What changes are included in this PR? - add an API in table provider that will return metadata column schema. - change DFSchema add metadata column. - change logical plan e.g. TableScan to support it. ## Are these changes tested? Unit test is added ## Are there any user-facing changes? No For FFI table provider API, one function that returns metadata column is added. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
