malinjawi commented on PR #12218: URL: https://github.com/apache/gluten/pull/12218#issuecomment-5070279448
Update: the standard x86 Spark 3.3 job caught a separate output-attribute regression in the first pushdown fix. Optimizing the whole reconstructed plan allowed Spark 3.3 to remove the aliases that preserve the original CDF relation expression IDs, so a parent sort later tried to bind a stale `name` attribute. I fixed that in bf2ac70f5 by optimizing only the filtered CDF child, then applying the output-restoring `Project` after the optimizer. This keeps predicate pushdown while preserving the expression IDs expected by already-planned parent operators. Spotless and Delta test-compiles pass for Spark 3.3 and Spark 4.1, and a fresh standard CI run is now queued on this head. The combined Delta run 29772714951 is still the earlier run against the old combined branch. @felipepessoto, could you please rerun it against bf2ac70f5 once the branch is refreshed? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
