2010YOUY01 commented on issue #18341: URL: https://github.com/apache/datafusion/issues/18341#issuecomment-3466384274
I've checked on `tpch sf1` on parquet generated with `benchmarks/` script, running q1 under `datafusion.execution.target_partitions=14`, with `explain analyze verbose` on the query. And nearly half of the partitions are actually empty. I think fixing it can significantly speed up tpch q1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
