mbutrovich commented on issue #2572: URL: https://github.com/apache/datafusion-comet/issues/2572#issuecomment-3403445885
> Right now, each executor’s Tokio runtime spins up one thread per physical core, which doesn’t seem reasonable. Do we need to align the number of Tokio runtime threads with the number of `spark executor cores?` Yeah I suspect this is fairly over-subscribing on threads. This might actually make sense for I/O heavy workloads with a lot of parallel requests (if we can manage to submit all of that), but it's definitely a good point of discussion. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
