DB Tsai created PARQUET-1809: -------------------------------- Summary: Add new APIs for nested predicate pushdown Key: PARQUET-1809 URL: https://issues.apache.org/jira/browse/PARQUET-1809 Project: Parquet Issue Type: New Feature Components: parquet-mr Reporter: DB Tsai
Currently, Parquet's *org.apache.parquet.filter2.predicate.FilterApi* is using *dot* to split the column name into multi-parts of nested fields. The drawback is that this causes issues when the field name contains *dot*. The new APIs that will be added will take array of string directly for multi-parts of nested fields, so no confusion as using *dot* as a separator. See https://github.com/apache/spark/pull/27728 and [SPARK-17636] for details. -- This message was sent by Atlassian Jira (v8.3.4#803005)