Github user lianhuiwang commented on the issue: https://github.com/apache/spark/pull/13585 @liancheng @chenghao-intel I think we can did it like mysql's range optimizer:http://dev.mysql.com/doc/refman/5.7/en/range-optimization.html. I have implemented it in my branch:https://github.com/lianhuiwang/spark/tree/partition_pruning. I did not combine many ranges because it will transform partition pruning predicates to Hive's filter expression in getPartitionsByFilter() and Hive's metastore database can filter partitions.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org