Yash Datta created PARQUET-115:
----------------------------------
Summary: Pass a filter object to user defined predicate in filter2
api
Key: PARQUET-115
URL: https://issues.apache.org/jira/browse/PARQUET-115
Project: Parquet
Issue Type: Improvement
Components: parquet-mr
Affects Versions: 1.6.0rc2
Reporter: Yash Datta
Priority: Minor
Fix For: parquet-mr_1.6.0
Currently for creating a user defined predicate using the new filter api, no
value can be passed to create a dynamic filter at runtime. This reduces the
usefulness of the user defined predicate, and meaningful predicates cannot be
created. We can add a generic Object value that is passed through the api,
which can internally be used in the keep function of the user defined predicate
for creating many different types of filters.
For example, in spark sql, we can pass in a list of filter values for a where
IN clause query and filter the row values based on that list.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
