[
https://issues.apache.org/jira/browse/ARROW-14642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17441288#comment-17441288
]
Percy Camilo Triveño Aucahuasi commented on ARROW-14642:
--------------------------------------------------------
Good points! Thanks David!
I was loading the TPC-H nation table and I saw that the MakeScanNode is using
the fragment implementation based on the FileSystemDataset::GetFragmentsImpl.
And from there I think the predicate is being accumulated but not used or
passed to the proper Parquet reader.
btw I'm ok to close this ticket, thanks David!
> [C++] ScanNode is not using the filter expression
> -------------------------------------------------
>
> Key: ARROW-14642
> URL: https://issues.apache.org/jira/browse/ARROW-14642
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Affects Versions: 7.0.0
> Reporter: Percy Camilo Triveño Aucahuasi
> Assignee: Percy Camilo Triveño Aucahuasi
> Priority: Major
> Labels: dataset, query-engine
> Fix For: 7.0.0
>
>
> The ScanNode can not apply predicate push-down, it seems the are some
> fragments that are not able to use or setting up properly the filter
> expression.
> {code:c++}
> auto options = std::make_shared<ScanOptions>();
> options->filter = filter_expression;
> compute::MakeExecNode("scan", plan.get(), {}, ScanNodeOptions{dataset,
> options}));
> {code}
> Also, if the ScanOptions doesn't have a projection expression the code just
> crash and I think I should create a default expression to include all the
> fields from the dataset schema.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
