Rohini Palaniswamy created PIG-4093:
---------------------------------------
Summary: Predicate pushdown to support removing filters from pig
plan
Key: PIG-4093
URL: https://issues.apache.org/jira/browse/PIG-4093
Project: Pig
Issue Type: Sub-task
Reporter: Rohini Palaniswamy
It is possible for the loaders to evaluate the pushed filter conditions. In
that case it is not necessary to retain the filter conditions in the pig plan.
So need to support two modes :
1) filter conditions are pushed into loader but also retained in pig plan
as loader might do only best effort filtering based on block metadata
2) filter conditions are pushed into loader and removed from pig plan when
the loader can evaluate the expression itself and filter out records. In this
case, loader can do lazy deserialization adn avoid deserialization of the full
record.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
