Tushar7012 commented on issue #19971: URL: https://github.com/apache/datafusion/issues/19971#issuecomment-3799881475
Thanks for the guidance. I’ll implement the simpler approach: spawn tasks directly inside list_files_for_scan (following #19969), collect with JoinSet, and keep the API unchanged. I’ll also respect the existing meta_fetch_concurrency for throttling. I’ll open a draft PR shortly and tag @BlakeOrth for any thoughts -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
