parthchandra commented on PR #3247: URL: https://github.com/apache/datafusion-comet/pull/3247#issuecomment-3792832450
> > @parthchandra do you have benchmarks showing the performance improvement? > > (Sorry, didn't notice this before merging). This likely won't have a performance benefit as much as it might help with the GC pressure we see when serializing the plan involving a large number of partitions. Didn't seem to have too much of an impact. FilePartition info went from `2.96%` of total allocation to `2.94%` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
