I agree it would be better if the projection did not include the columns
needed (only) for the pushdown filter . As Jie Wen says, it would be a nice
thing to improve.
Would you be willing to file a ticket to track this issue? If not I can do
so.
Thanks,
Andrew
On Wed, Apr 12, 2023 at 2:13 AM v
Hi,
The current "Projection pushdown" rule was implemented by me previously.
I believe the key issue is the execution order of the internal projection
and filter of the `TableScan` operator.
If we do `projection` before `filter`, `Projection [col1, col2]` would be
essential. Otherwise, we will mi
Hello,
I hope this is the right place to ask this.
While working on a project based on arrow-datafusion, I came across some weird
behavior where a projection did not get eliminated as expected, thus breaking a
custom optimizer rule's assumption (into which I won't go further, as it's not
impor
