DB Tsai created PARQUET-1809:
--------------------------------

             Summary:  Add new APIs for nested predicate pushdown
                 Key: PARQUET-1809
                 URL: https://issues.apache.org/jira/browse/PARQUET-1809
             Project: Parquet
          Issue Type: New Feature
          Components: parquet-mr
            Reporter: DB Tsai


Currently, Parquet's *org.apache.parquet.filter2.predicate.FilterApi* is using 
*dot* to split the column name into multi-parts of nested fields. The drawback 
is that this causes issues when the field name contains *dot*.

The new APIs that will be added will take array of string directly for 
multi-parts of nested fields, so no confusion as using *dot* as a separator.  

See https://github.com/apache/spark/pull/27728 and [SPARK-17636] for details.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to