sunchao commented on PR #57248: URL: https://github.com/apache/spark/pull/57248#issuecomment-4972289404
To me, I'm fine to make this not blocking RC6. Spark uses canonicalized plans only for AQE and reuse comparisons, not execution. A plugin or fallback path could reconstruct a scan with reordered mixed-type partition keys, causing a deterministic `ClassCastException` that visibly fails the query, not silent incorrect results. Users can still disable SPJ with `spark.sql.sources.v2.bucketing.enabled=false`. Therefore, I'm OK to proceed with RC6 and promptly back-port the fix unless broader impact is demonstrated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
