andygrove commented on PR #6455: URL: https://github.com/apache/datafusion-comet/pull/6455#issuecomment-5955979738
Closing in favor of #6542. Rather than rescale in the dispatcher and keep chasing every place Spark reads the value as returned, that PR stops dispatching DataSource V2 functions at all, which is what 1.0.0 did. It turns the `StaticInvoke`/`Invoke` catch-all from #5692 into an allow list of Spark's own classes and checks the whole dispatched tree, so the cases found here (transitive parents, projected aliases, `explode`, a dispatched `map(...)`, `ApplyFunctionExpression`) all fall back to Spark. @sunchao @parthchandra @comphead those cases are now the tests in #6542. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
