Yeah, this is unfortunate. It would be good to fix this, but its a non-trivial change.
Tracked here if you'd like to vote on the issue: https://issues.apache.org/jira/browse/SPARK-4502 On Thu, Oct 29, 2015 at 6:00 PM, Sadhan Sood <sadhan.s...@gmail.com> wrote: > I noticed when querying struct data in spark sql, we are requesting the > whole column from parquet files. Is this intended or is there some kind of > config to control this behaviour? Wouldn't it be better to request just the > struct field? >
