Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20387
> It's hard to improve PhysicalOperation to support more operators and
specific push down orders, so I created the new one
I'm concerned about the new one. The projection support seems really
brittle because it calls out specific logical nodes and scans the entire plan.
If we are doing push-down wrong on the current v1 and Hive code paths, then I'd
like to see a proposal for fixing that without these drawbacks.
I like that this PR pushes projections and filters just like the other
paths. We should start there and add additional push-down as necessary.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
