andygrove commented on issue #495: URL: https://github.com/apache/datafusion-comet/issues/495#issuecomment-2166104979
When running TPC-H q16 with DataFusion, there is a significant difference in performance between runs with coalesce batches enabled vs disabled. With `datafusion.execution.coalesce_batches=true`: ``` Query 16 executed in: 1.907695417s and returned 27840 rows Query 16 executed in: 1.900346945s and returned 27840 rows Query 16 executed in: 1.913095568s and returned 27840 rows ``` With `datafusion.execution.coalesce_batches=false`: ``` Query 16 executed in: 3.06827928s and returned 27840 rows Query 16 executed in: 3.052310983s and returned 27840 rows Query 16 executed in: 3.222817185s and returned 27840 rows ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
