alamb commented on pull request #1241: URL: https://github.com/apache/arrow-datafusion/pull/1241#issuecomment-964102672
> it might be a silly question, but would you be able to provide color on why the physical explain plan depend on the number of cores? It is not silly at all @matthewmturner -- the core reason is that the target concurrency defaults to the number of cores -- so when DataFusion goes through the exercise is splitting the input into several output datastreams (`partitons`), it tries to make just enough output streams to keep all the cores busy. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
