Weston Pace created ARROW-16275:
-----------------------------------

             Summary: [C++] Add support for pushdown projection of nested 
references
                 Key: ARROW-16275
                 URL: https://issues.apache.org/jira/browse/ARROW-16275
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Weston Pace


Now that we support nested field references we should support pushdown 
predicates based on nested field references.  For example:

{noformat}
dataset.to_table(filter=ds.field('values', 'one') > 200)
{noformat}

{{file_parquet.cc}} tests which row groups to include when scanning a parquet 
fragment using parquet statistics.  At the moment it skips any non-leaf 
columns.  That will need to change.

Second, even if we were able to detect and produce a guarantee based on nested 
references, it's not clear the simplification logic would be able to detect 
this and appropriately simplify.  So there may be changes needed there too.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

Reply via email to