Github user mallman commented on the issue:
https://github.com/apache/spark/pull/21320
> https://issues.apache.org/jira/browse/SPARK-25879
>
> If we select a nested field and a top level field, the schema pruning
will fail. Here is the reproducible test,
> ...
Hi @dbtsai.
I believe the problem you're seeing here is resolved by #22880
(https://issues.apache.org/jira/browse/SPARK-25407). It was a known problem at
the time this PR was merged, but was pushed back to a future commit.
Coincidentally, I just posted #22880 today.
The test case you provide is very similar to the test case introduced and
exercised in that PR. I manually ran your test case on that branch locally, and
the test passed. Would you like to try that branch and comment?
Cheers.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
