Rachelint commented on issue #12596: URL: https://github.com/apache/datafusion/issues/12596#issuecomment-2373624381
> I think our goal is to combine partial + repartition + final into single operator, and partial + repartition fusing is the first step of this. After that we could try doing final aggr step as well. Yes, it may be attractive if we combine them by someway, we seems to have chance to do more optimizations. 🤔 - Now we build `record batch` from `partial` internal states. - Then pass them to `final` - And after we need to copy the needed data and put them to `final`'s internal states. It seems to be expensive for bytes and string? Maybe we can pass the internal states directly to `final`, seems we can avoid some copies? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
