Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/10577#issuecomment-169216470 Major changes in this commit: - Combine the Union during the construction (i.e., in the DataFrame and Dataset APIs) - Use tail recursive with extractor object to reimplement the rule `CombineUnions` - Rename the operator `Unions` to `Union` - Fix bugs Todo: - Change the optimizer rule for pushing Filter and Project through Unions.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org