Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22573
I think the problem is, the current public `Filter` API uses string as the
attribute type, which is hard to represent nested fields.
Ideally we should extend the API, create a new interface for column and
nested column, instead of string. But `Filter` is a public API so this is hard
to do.
This PR proposes to encode nested columns as string. This works, but we
should think carefully about how to encode, so that column name with dot is
still supported.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
