Neuw84 commented on PR #6270: URL: https://github.com/apache/datafusion-comet/pull/6270#issuecomment-5914439449
If curious the details are here: https://vecruntime.github.io/vecruntime/benchmarks/tpcds-1tb.html The plan is also have a more hybrid approach where I can customize operators, but I need more time on that. Other than that seems like the arrowflight columnar shuffle is quite performant, maybe can be also be used as inspiration for comet ( on vecruntime I can also plug comet columnar shuffle). I know that there is some discussions on a new shuffle! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
