pmcgleenon commented on issue #17721: URL: https://github.com/apache/datafusion/issues/17721#issuecomment-3499161671
@alamb here are the initial results. [report.zip](https://github.com/user-attachments/files/23400667/report.zip) I've added them to the Clickbench html page so they can be compared with the previous version "DataFusion-old". [version 47 ](https://github.com/ClickHouse/ClickBench/blob/main/datafusion-partitioned/benchmark.sh#L16) looks to be the previous version tested. I needed to Select Metric "Hot Run" to get the hot run results - For partitioned, the results are similar to the previous version for `c8g.4xlarge` and `c6a.x4large` - For single, v50 looks faster overall Q23 looks a lot slower on `c6a.2xlarge` compared to the other instances for both single and partitioned files. I didn't analyse it but it seems like it could be hitting the memory limit on the 16GB RAM machine and works better on the higher spec machines Let me know how these look, if anything looks weird shout out and I can rerun it. If it seems ok I can create a PR for the clickbench repository -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
