Dandandan commented on PR #22010: URL: https://github.com/apache/datafusion/pull/22010#issuecomment-4386266755
<img width="731" height="491" alt="image" src="https://github.com/user-attachments/assets/b2e90d85-8981-49cf-8d60-81eaa50c9cd1"; /> From: Apache Arrow DataFusion: a Fast, Embeddable, Modular Analytic Query Engine https://andrew.nerdnetworks.org/pdf/SIGMOD-2024-lamb.pdf I think there is some overlap of these 2024 figures at high core counts (>32 cores) and the reported improvements here. @alamb @gabotechs perhaps it would be good to redo this experiment once more. With morsel scan + optimization like this I expect this picture to look much better for the higher core counts :) Perhaps we could also test clickbench just on higher core counts and see if it improves. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
