Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/17286 @ioana-delaney Thanks for the replies. > Given A J1 B J2 C: - case 1 ⢠level 0: (A), (B), (C) ⢠level 1: {A, B}, ~~{A, C}~~, {B, C} ⢠level 3: {A, B, C} Given A J1 B J2 C cross join D - case 2 ⢠level 0: (A), (B), (C), (D) ⢠level 1: {A, B}, ~~{A, C}, {A, D}~~, {B, C}, ~~{B, D}~~ ⢠level 3: {A, B, C}, ~~{A, B, D}, {A, C, D}, {B, C, D}~~ ⢠level 4: {A, B, C, D} Currently the algorithm can prune cartesian products in case 1. For case 2, now it is based on the output of `ReorderJoin`, cartesian products are put at the end. So we have the same effect on the final plan. In the future, we can merge these rules together.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org