Jinfeng Ni created DRILL-3765:
---------------------------------

             Summary: Partition prune rule is unnecessary fired multiple times. 
                 Key: DRILL-3765
                 URL: https://issues.apache.org/jira/browse/DRILL-3765
             Project: Apache Drill
          Issue Type: Bug
          Components: Query Planning & Optimization
            Reporter: Jinfeng Ni
            Assignee: Jinfeng Ni


It seems that the partition prune rule may be fired multiple times, even after 
the first rule execution has pushed the filter into the scan operator. Since 
partition prune has to build the vectors to contain the partition /file / 
directory information, to invoke the partition prune rule unnecessary may lead 
to big memory overhead.

Drill planner should avoid the un-necessary partition prune rule, in order to 
reduce the chance of hitting OOM exception, while the partition prune rule is 
executed.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to