Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21118
@cloud-fan, @jose-torres, I think this is ready for final review. I've
rebased on top of the rename to `InputPartition`.
I've also added a projection when this produces a physical plan to ensure
that the rows are `UnsafeRow` when they are passed to other operators. When we
eventually move filter and projection pushdown to the conversion to a physical
plan, we can put filters below the projection to avoid extra copies of rows
that will be filtered out. From discussion here and on the list, I think this
is a reasonable way to move forward.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
